Dual lens system having a light splitter

ABSTRACT

Imaging systems having multiple optical modules are provided. The FOVs, focal lengths, and/or sensors of the multiple optical modules may be designed to generate high quality images and images with arbitrary magnifications.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of International Application No.PCT/CN2015/083783, filed Jul. 10, 2015, the disclosure of which ishereby incorporated by reference in its entirety.

BACKGROUND

Imaging devices of wide ranging sizes and capabilities have beendeveloped for a variety of applications. For example, imaging devicesmay be used as a stand-alone device by professional photographers orcinematographers. In some instances, imaging devices may be integratedas a component into systems having other various capabilities (e.g.,smart phones, tablets). In some instances, imaging devices may becarried on board movable objects, such as unmanned aerial vehicles(UAVs), and be utilized for surveillance, search and rescue operations,exploration, and other activities.

A plurality of optical modules may be provided within an imaging system.The optical modules may have a specific configuration and/or be coupledto an optical element. The optical modules may each acquire images. Theacquired images may be combined and images having arbitrarymagnification may be generated. Existing approaches for generation ofimages may be less than optimal in some instances. For example, opticalzooming systems may be heavy, large, and expensive. Digital zoomingsystems may have poor performance. Furthermore, existing imagegeneration systems may be subject to computational difficulties andghosting problems.

SUMMARY

Embodiments disclosed herein provide systems and methods for capturingimages and/or generating a combined image. Imaging devices may beutilized in capturing the images and/or acquiring the combined image.The imaging devices may capture two or more images at a given timepoint. The two or more images may or may not have an optical parallax. Acenter of the two or more images may coincide. In some instances, thetwo or more images may be combined to generate a combined image.Advantageously, the approaches described herein may eliminate needs forcomplex image matching algorithms, needs for image depth estimation, andmatching accuracy may be improved with less computational loads ingenerating a combined image.

Thus, in one aspect, a method for capturing images is provided. Themethod comprises: separating, with aid of an optical element, light intoa first light beam and a second light beam; focusing, with aid of afirst lens module having a first local length, the first light beam;focusing, with aid of a second lens module having a second focal length,the second light beam, wherein the second focal length is different fromthe first focal length; capturing, with aid of a first sensor, a firstimage from the first light beam focused by the first lens module ontothe first sensor; and capturing, with aid of a second sensor, a secondimage from the second light beam focused by the second lens module ontothe second sensor.

In some embodiments, the first image has a first field of view and thesecond image has a second field of view different from the first fieldof view. In some embodiments, the second field of view covers the secondfield of view. In some embodiments, the first field of view covers thesecond field of view. In some embodiments, the first light beam is areflected part of the light and the second light beam is a refractedpart of the light. In some embodiments, the first lens module is atelescope lens module and the second lens module is a wide-angled lensmodule. In some embodiments, the first lens module comprises awide-angled lens module and the second lens module comprises a telescopelens module. In some embodiments, an optical axis of the first lensmodule and an optical axis of the second lens module coincide withrespect to an angular bisector of a reflection angle and a refractionangle. In some embodiments, an optical axis of the first lens module andan optical axis of the second lens module coincide with each other. Insome embodiments, the optical axis of the first lens module and anoptical axis of the second lens module are perpendicular. In someembodiments, the light passes through a single aperture prior to contactwith the optical element. In some embodiments, a center of the firstimage and the second image coincide. In some embodiments, the opticalelement is a translucent film reflector. In some embodiments, theoptical element is a beam splitter. In some embodiments, the first lensmodule and the second lens module each comprise only prime lenses. Insome embodiments, the first sensor and the second sensor are of a sametype. In some embodiments, the first sensor and the second sensor haveidentical sizes. In some embodiments, a size of each pixel on the firstsensor and the second sensor are identical. In some embodiments, thefirst sensor and the second sensor are of a different type. In someembodiments, an optical parallax is absent between an optical axis ofthe first lens module and an optical axis of the second lens module. Insome embodiments, a parallax is absent between the first image and thesecond image. In some embodiments, the method further comprisescombining, with aid of one or more processors, the first image with thesecond image. In some embodiments, the method further comprisesreceiving, at one or more processors, a desired focal length, whereinthe combined image has a field of view corresponding to the desiredfocal length. In some embodiments, the desired focal length correspondsto a desired field of view. In some embodiments, the desired focallength is equal to or greater than at least one of the first focallength or the second focal length. In some embodiments, combining thefirst image with the second image comprises scaling the first image by

$\frac{{the}\mspace{14mu} {desired}\mspace{14mu} {focal}{\mspace{11mu} \;}{length}}{{the}{\; \mspace{11mu}}{first}{\mspace{11mu} \;}{focal}\mspace{14mu} {length}}$

and the second image by

$\frac{{the}\mspace{14mu} {desired}\mspace{14mu} {focal}{\mspace{11mu} \;}{length}}{{the}{\; \mspace{11mu}}{second}{\mspace{11mu} \;}{focal}\mspace{14mu} {length}}.$

In some embodiments, scaling the first image and second image utilize acubic interpolation algorithm or a bilinear interpolation algorithm. Insome embodiments, combining the first image with the second imagecomprises fusing the scaled first image and the scaled second image. Insome embodiments, the combined image is comprised wholly of fused partswhen the desired focal length is greater than the first focal length andthe second focal length. In some embodiments, the combined image iscomprised of an inner field of view comprised of fused parts and anouter field of view comprised of the first scaled image or the secondscaled image, whichever has a wider field of view when the desired focallength is between the first focal length and the second focal length. Insome embodiments, fusing the scaled first image and the scaled secondimage utilizes a Laplacian pyramid algorithm or a weighted averagealgorithm. In some embodiments, pixel fusion occurs for areas in which afield of view of the first scaled image and the second scaled imageoverlaps. In some embodiments, the first lens module comprises at leastone lens. In some embodiments, the first lens module comprises a lensbarrel configured to receive the at least one lens. In some embodiments,the second lens module comprises at least one lens. In some embodiments,the second lens module comprises a lens barrel configured to receive theat least one lens.

In another aspect, a system for capturing images is provided. The systemcomprises: an optical element configured to separate light into a firstlight beam and a second light beam; a first lens module having a firstfocal length configured to focus the first light beam; a second lensmodule having a second focal length configured to focus the second lightbeam, wherein the second focal length is different from the first locallength; a first sensor configured to capture a first image from thefirst light beam focused by the first lens module onto the first sensor;and a second sensor configured to capture a second image from the secondlight beam focused by the second lens module onto the second sensor.

In some embodiments, the first image has a first field of view and thesecond image has a second field of view different from the first fieldof view. In some embodiments, the second field of view covers the secondfield of view. In some embodiments, the first field of view covers thesecond field of view. In some embodiments, the first light beam is areflected part of the light and the second light beam is a refractedpart of the light. In some embodiments, the first lens module is atelescope lens module and the second lens module is a wide-angled lensmodule. In some embodiments, the first lens module comprises awide-angled lens module and the second lens module comprises a telescopelens module. In some embodiments, an optical axis of the first lensmodule and an optical axis of the second lens module coincide withrespect to an angular bisector of a reflection angle and a refractionangle. In some embodiments, an optical axis of the first lens module andan optical axis of the second lens module coincide with each other. Insome embodiments, the optical axis of the first lens module and anoptical axis of the second lens module are perpendicular. In someembodiments, the light passes through a single aperture prior to contactwith the optical element. In some embodiments, a center of the firstimage and the second image coincide. In some embodiments, the opticalelement is a translucent film reflector. In some embodiments, theoptical element is a beam splitter. In some embodiments, the first lensmodule and the second lens module each comprise only prime lenses. Insome embodiments, the first sensor and the second sensor are of a sametype. In some embodiments, the first sensor and the second sensor haveidentical sizes. In some embodiments, a size of each pixel on the firstsensor and the second sensor are identical. In some embodiments, thefirst sensor and the second sensor are of a different type. In someembodiments, an optical parallax is absent between an optical axis ofthe first lens module and an optical axis of the second lens module. Insome embodiments, a parallax is absent between the first image and thesecond image. In some embodiments, the system further comprises one ormore processors, wherein the one or more processors are configured tocombine the first image with the second image. In some embodiments, theone or more processors are configured to receive a desired focal lengthand generate a combined image, wherein the combined image has a field ofview corresponding to the desired focal length. In some embodiments, thedesired focal length corresponds to a desired field of view. In someembodiments, the desired focal length is equal to or greater than atleast one of the first focal length or the second focal length. In someembodiments, the one or more processors are configured to scale thefirst image by the desired focal length/the first focal length and thesecond image by the desired focal length/the second focal length. Insome embodiments, the one or more processors are configured to utilize acubic interpolation algorithm or a bilinear interpolation algorithm toscale the first image and the second image. In some embodiments, the oneor more processors are configured to fuse the scaled first image and thescaled second image. In some embodiments, the combined image iscomprised wholly of fused parts when the desired focal length is greaterthan the first focal length and the second focal length. In someembodiments, the combined image is comprised of an inner field of viewcomprised of fused parts and an outer field of view comprised of thefirst scaled image or the second scaled image, whichever has a widerfield of view when the desired focal length is between the first focallength and the second focal length. In some embodiments, the one or moreprocessors are configured to utilize a Laplacian pyramid algorithm or aweighted average algorithm to fuse the scaled first image and the scaledsecond image. In some embodiments, the one or more processors areconfigured to fuse the scaled first image and the scaled second imagevia pixel fusion. In some embodiments, pixel fusion occurs for areas inwhich a field of view of the first scaled image and the second scaledimage overlaps. In some embodiments, the first lens module comprises atleast one lens. In some embodiments, the first lens module comprises alens barrel configured to receive the at least one lens. In someembodiments, the second lens module comprises at least one lens. In someembodiments, the second lens module comprises a lens barrel configuredto receive the at least one lens.

In another aspect, a method for generating a combined image is provided.The method comprises: acquiring, with aid of a first lens module, afirst image; acquiring, with aid of a second lens module, a secondimage, wherein an optical axis of the first lens module and an opticalaxis of the second lens module coincide and are perpendicular;receiving, at one or more processors, the first image; receiving, at oneor more processors, the second image; and combining, with aid of one ormore processors, the first image with the second image.

In some embodiments, the first image has a first field of view and thesecond image has a second field of view different from the first fieldof view. In some embodiments, the first lens module has a first focallength f1 and the second lens module has a second focal length f2,wherein f1 is greater than f2. In some embodiments, a field of view ofthe second lens module is greater than a field of view of the first lensmodule. In some embodiments, the method further comprises receiving, atthe one or more processors, a desired focal length f, wherein thecombined image has a field of view corresponding to the desired focallength f. In some embodiments, combining the first image with the secondimage comprises scaling the first image by f/f1 and the second image byf/f2. In some embodiments, scaling the first and second images utilizesa cubic interpolation algorithm or a bilinear interpolation algorithm.In some embodiments, combining the first image with the second imagecomprises fusing the scaled first image and the scaled second image. Insome embodiments, the combined image is comprised wholly of fused partswhen f is greater than f1. In some embodiments, the combined image iscomprised of an inner field of view comprised of fused parts and anouter field of view comprised of the second scaled image when thedesired focal length is between the first focal length and the secondfocal length. In some embodiments, fusing the scaled first image and thescaled second image utilizes a Laplacian pyramid algorithm or a weightedaverage algorithm. In some embodiments, fusing the scaled first imageand the scaled second image comprises pixel fusion. In some embodiments,pixel fusion occurs for areas in which a field of view of the firstscaled image and the second scaled image overlaps. In some embodiments,the first lens module is a telescope lens module and the second lensmodule is a wide-angled lens module. In some embodiments, the first lensmodule and the second lens module each comprise only prime lenses. Insome embodiments, an optical parallax is absent between an optical axisof the first lens and an optical axis of the second lens. In someembodiments, a parallax is absent between the first image and the secondimage. In some embodiments, the combined image is displayed on a mobiledevice. In some embodiments, the mobile device is a cellphone, PDA,tablet, or controller. In some embodiments, the combined image isdisplayed in real time.

In another aspect, an imaging system for generating a combined image isprovided. The system comprises: a first lens module configured to aid inacquiring a first image; a second lens module configured to aid inacquiring a second image, wherein an optical axis of the first lensmodule and an optical axis of the second lens module coincide and areperpendicular; and one or more processors individually or collectivelyconfigured to: receive the first image; receive the second image; andcombine the first image with the second image.

In some embodiments, the first image has a first field of view and thesecond image has a second field of view different from the first fieldof view. In some embodiments, the first lens module has a first focallength f1 and the second lens module has a second focal length f2,wherein f1 is greater than f2. In some embodiments, a field of view ofthe second lens module is greater than a field of view of the first lensmodule. In some embodiments, the one or more processors are configuredto receive a desired focal length f and generate a combined image,wherein the combined image has a field of view corresponding to thedesired focal length f. In some embodiments, the one or more processorsare configured to scale the first image by f/f1 and the second image byf/f2. In some embodiments, the one or more processors are configured toutilize a cubic interpolation algorithm or a bilinear interpolationalgorithm to scale the first image and the second image. In someembodiments, the one or more processors are configured to fuse thescaled first image and the scaled second image. In some embodiments, acombined image is comprised wholly of fused parts when f is greater thanf1. In some embodiments, a combined image is comprised of an inner fieldof view comprised of fused parts and an outer field of view comprised ofthe second scaled image when the desired focal length is between thefirst focal length and the second focal length. In some embodiments, theone or more processors are configured to utilize a Laplacian pyramidalgorithm or a weighted average algorithm to fuse the scaled first imageand the scaled second image. In some embodiments, the one or moreprocessors are configured to utilize pixel fusion to fuse the scaledfirst image and the scaled second image. In some embodiments, the one ormore processors are configured to utilize pixel fusion occurs for areasin which a field of view of the first scaled image and the second scaledimage overlaps. In some embodiments, the first lens module is atelescope lens module and the second lens module is a wide-angled lensmodule. In some embodiments, the first lens module and the second lensmodule each comprise only prime lenses. In some embodiments, an opticalparallax is absent between an optical axis of the first lens and anoptical axis of the second lens. In some embodiments, a parallax isabsent between the first image and the second image. In someembodiments, the system further comprises a mobile device configured todisplay the combined image. In some embodiments, the mobile device is acellphone, PDA, tablet, or controller. In some embodiments, the combinedimage is displayed in real time.

In another aspect, a movable system is provided. The movable systemcomprises: a movable platform; the imaging system previously describedherein configured to be mounted on the movable platform; and a gimbalconfigured to stabilize the imaging system. In some embodiments, thegimbal is configured to rotate the imaging system with respect to themovable platform.

In another aspect, a method for capturing images is provided. The methodcomprises: effecting movement of a movable platform; receiving, at animaging device, light, wherein the imaging device comprises an opticalelement, a first lens module, a second lens module, a first sensor, anda second sensor; separating, with aid of the optical element, the lightinto a first light beam and a second light beam; focusing, with aid ofthe first lens module, the first light beam; focusing, with aid of thesecond lens module, the second light beam; capturing, with aid of thefirst sensor, a first image from the first light beam focused by thefirst lens module onto the first sensor; and capturing, with aid of thesecond sensor, a second image from the second light beam focused by thesecond lens module onto the second sensor.

In some embodiments, the movable platform is an unmanned aerial vehicle.In some embodiments, movement of the movable platform is effected withaid of one or more propulsion units. In some embodiments, the first lensmodule has a first focal length and the second lens module has a secondfocal length different from the first focal length. In some embodiments,the first focal length is greater than the second focal length. In someembodiments, a field of view of the second lens module is greater than afield of view of the first lens module. In some embodiments, the firstlight beam is a reflected part of the light and the second light beam isa refracted part of the light. In some embodiments, an optical axis ofthe first lens module and an optical axis of the second lens modulecoincide with respect to an angular bisector of a reflection angle and arefraction angle. In some embodiments, the first lens module is atelescope lens module and the second lens module is a wide-angled lensmodule. In some embodiments, the first lens module comprises at leastone lens. In some embodiments, the first lens module comprises a lensbarrel configured to receive the at least one lens. In some embodiments,the first lens module is a wide-angled lens module and the second lensis a telescope lens module. In some embodiments, the method furthercomprises combining, with aid of one or more processors, the first imagewith the second image. In some embodiments, the method further comprisesreceiving, at one or more processors, a desired focal length, whereinthe combined image has a field of view corresponding to the desiredfocal length. In some embodiments, the desired focal length is equal toor greater than at least one of the first focal length or the secondfocal length. In some embodiments, the method further comprisesdisplaying the combined image on a mobile device. In some embodiments,the mobile device is a cellphone, PDA, tablet, or controller. In someembodiments, the combined image is displayed in real time. In someembodiments, combining the first image with the second image comprisesscaling the first image by

$\frac{{the}\mspace{14mu} {desired}\mspace{14mu} {focal}{\mspace{11mu} \;}{length}}{{the}{\; \mspace{11mu}}{first}{\mspace{11mu} \;}{focal}\mspace{14mu} {length}}$

and the second image by

$\frac{{the}\mspace{14mu} {desired}\mspace{14mu} {focal}{\mspace{11mu} \;}{length}}{{the}{\; \mspace{11mu}}{second}{\mspace{11mu} \;}{focal}\mspace{14mu} {length}}.$

In some embodiments, scaling the first image and second image utilize acubic interpolation algorithm or a bilinear interpolation algorithm. Insome embodiments, combining the first image with the second imagecomprises fusing the scaled first image and the scaled second image. Insome embodiments, the combined image is comprised wholly of fused partswhen the desired focal length is greater than the first focal length andthe second focal length. In some embodiments, the combined image iscomprised of an inner field of view comprised of fused parts and anouter field of view comprised of the first scaled image or the secondscaled image, whichever has a wider field of view when the desired focallength is between the first focal length and the second focal length. Insome embodiments, fusing the scaled first image and the scaled secondimage utilizes a Laplacian pyramid algorithm or a weighted averagealgorithm. In some embodiments, fusing the scaled first image and thescaled second image comprises pixel fusion. In some embodiments, pixelfusion occurs for areas in which a field of view of the first scaledimage and the second scaled image overlaps. In some embodiments, anoptical axis of the first lens module and an optical axis of the secondlens module coincide. In some embodiments, the optical axis of the firstlens module and an optical axis of the second lens module areperpendicular. In some embodiments, the light passes through a singleaperture prior to contact with the optical element. In some embodiments,a center of the first image and the second image coincide. In someembodiments, the optical element is a translucent film reflector. Insome embodiments, the optical element is a beam splitter. In someembodiments, the first lens module and the second lens module compriseonly prime lenses. In some embodiments, the first lens module is atelescope lens module and the second lens module is a wide-angled lensmodule. In some embodiments, the first sensor and the second sensor areof a same type. In some embodiments, the first sensor and the secondsensor are of a different type. In some embodiments, an optical parallaxis absent between an optical axis of the first lens module and anoptical axis of the second lens module. In some embodiments, a parallaxis absent between the first image and the second image. In someembodiments, the method further comprises mounting the imaging device tothe movable platform with a gimbal. In some embodiments, the gimbal isconfigured stabilize the imaging device. In some embodiments, the gimbalis configured to rotate the imaging device with respect to the moveableplatform.

In another aspect, a system for capturing images is provided. The systemcomprises: a moveable platform; and an imaging device mounted on themoveable platform configured to receive light, wherein the imagingdevice comprises: an optical element configured to separate the lightinto a first light beam and a second light beam; a first lens moduleconfigured to focus the first light beam; a second lens moduleconfigured to focus the second light beam; a first sensor configured tocapture a first image from the first light beam focused by the firstlens module onto the first sensor; and a second sensor configured tocapture a second image from the second light beam focused by the secondlens module onto the second sensor.

In some embodiments, the moveable platform is an unmanned aerialvehicle. In some embodiments, movement of the moveable platform iseffected with aid of one or more propulsion units. In some embodiments,the first lens module has a first focal length and the second lensmodule has a second focal length different from the first focal length.In some embodiments, the first focal length is greater than the secondfocal length. In some embodiments, a field of view of the second lensmodule is greater than a field of view of the first lens module. In someembodiments, the first light beam is a reflected part of the light andthe second light beam is a refracted part of the light. In someembodiments, an optical axis of the first lens module and an opticalaxis of the second lens module coincide with respect to an angularbisector of a reflection angle and a refraction angle. In someembodiments, the first lens module is a telescope lens module and thesecond lens module is a wide-angled lens module. In some embodiments,the first lens module comprises at least one lens. In some embodiments,the first lens module comprises a lens barrel configured to receive theat least one lens. In some embodiments, the first lens module is awide-angled lens module and the second lens is a telescope lens module.In some embodiments, the system further comprises one or moreprocessors, wherein the one or more processors are configured to combinethe first image with the second image. In some embodiments, the one ormore processors are configured to receive a desired focal length andgenerate a combined image having a field of view corresponding to thedesired focal length. In some embodiments, the desired focal length isequal to or greater than at least one of the first focal length or thesecond focal length. In some embodiments, the system further comprises amobile device configured to display the combined image. In someembodiments, the mobile device is a cellphone, PDA, tablet, orcontroller. In some embodiments, the combined image is displayed in realtime. In some embodiments, the one or more processors are configured toscale the first image by

$\frac{{the}\mspace{14mu} {desired}\mspace{14mu} {focal}{\mspace{11mu} \;}{length}}{{the}{\; \mspace{11mu}}{first}{\mspace{11mu} \;}{focal}\mspace{14mu} {length}}$

and the second image by

$\frac{{the}\mspace{14mu} {desired}\mspace{14mu} {focal}{\mspace{11mu} \;}{length}}{{the}{\; \mspace{11mu}}{second}{\mspace{11mu} \;}{focal}\mspace{14mu} {length}}$

to generate the combined image. In some embodiments, the one or moreprocessors are configured to utilize a cubic interpolation algorithm ora bilinear interpolation algorithm to scale the first image and thesecond image. In some embodiments, the one or more processors areconfigured to fuse the scaled first image and the scaled second image togenerate the combined image. In some embodiments, the combined image iscomprised wholly of fused parts when the desired focal length is greaterthan the first focal length and the second focal length. In someembodiments, the combined image is comprised of an inner field of viewcomprised of fused parts and an outer field of view comprised of thefirst scaled image or the second scaled image, whichever has a widerfield of view when the desired focal length is between the first focallength and the second focal length. In some embodiments, the one or moreprocessors are configured to utilize a Laplacian pyramid algorithm or aweighted average algorithm to fuse the scaled first image and the scaledsecond image. In some embodiments, one or more processors are configuredto fuse the scaled first image and the scaled second image via pixelfusion. In some embodiments, pixel fusion occurs for areas in which afield of view of the first scaled image and the second scaled imageoverlaps. In some embodiments, an optical axis of the first lens moduleand an optical axis of the second lens module coincide. In someembodiments, the optical axis of the first lens module and an opticalaxis of the second lens module are perpendicular. In some embodiments,the light passes through a single aperture prior to contact with theoptical element. In some embodiments, a center of the first image andthe second image coincide. In some embodiments, the optical element is atranslucent film reflector. In some embodiments, the optical element isa beam splitter. In some embodiments, the first lens module and thesecond lens module comprise only prime lenses. In some embodiments, thefirst lens module is a telescope lens module and the second lens moduleis a wide-angled lens module. In some embodiments, the first sensor andthe second sensor are of a same type. In some embodiments, the firstsensor and the second sensor are of a different type. In someembodiments, an optical parallax is absent between an optical axis ofthe first lens module and an optical axis of the second lens module. Insome embodiments, a parallax is absent between the first image and thesecond image. In some embodiments, the system further comprises a gimbalconfigured to mount the imaging device to the moveable platform. In someembodiments, the gimbal is configured stabilize the imaging device. Insome embodiments, the gimbal is configured to rotate the imaging devicewith respect to the moveable platform.

In another aspect, a method for capturing images is provided. The methodcomprises: separating, with aid of an optical element, light into afirst light beam and a second light beam; focusing, with aid of a firstlens module, the first light beam; focusing, with aid of a second lensmodule, the second light beam; capturing, with aid of a first sensor, afirst image from the first light beam focused by the first lens moduleonto the first sensor, wherein the first sensor has a first sensor size;and capturing, with aid of a second sensor, a second image from thesecond light beam focused by the second lens module onto the secondsensor, wherein the second sensor has a second sensor size differentfrom the first size.

In some embodiments, the first image has a first field of view and thesecond image has a second field of view different from the first fieldof view. In some embodiments, the first light beam is a reflected partof the light and the second light beam is a refracted part of the light.In some embodiments, an optical axis of the first lens module and anoptical axis of the second lens module coincide with respect to anangular bisector of a reflection angle and a refraction angle. In someembodiments, the first lens module and the second lens module haveidentical focal lengths. In some embodiments, the first sensor size islarger than the second sensor size. In some embodiments, each individualpixel on the first sensor is equal to or larger than each individualpixel on the second sensor. In some embodiments, an optical axis of thefirst lens module and an optical axis of the second lens modulecoincide. In some embodiments, the optical axis of the first lens moduleand an optical axis of the second lens module are perpendicular. In someembodiments, the light passes through a single aperture prior to contactwith the optical element. In some embodiments, a center of the firstimage and the second image coincide. In some embodiments, the opticalelement is a translucent film reflector. In some embodiments, theoptical element is a beam splitter. In some embodiments, the first lensmodule and the second lens module comprise only prime lenses. In someembodiments, the first sensor and the second sensor are of a same type.In some embodiments, the first sensor and the second sensor are of adifferent type. In some embodiments, an optical parallax is absentbetween an optical axis of the first lens module and an optical axis ofthe second lens module. In some embodiments, a parallax is absentbetween the first image and the second image. In some embodiments, themethod further comprises combining, with aid of one or more processors,the first image with the second image. In some embodiments, the methodfurther comprises receiving, at one or more processors, a desired fieldof view, wherein the combined image has a combined field of viewcorresponding to the desired field of view. In some embodiments, thefirst image has a first field of view and the second image has a secondfield of view different from the first field of view. In someembodiments, the desired field of view is equal to or narrower than atleast one of the first field of view or the second field of view. Insome embodiments, the first sensor size is larger than the second sensorsize. In some embodiments, the first field of view is wider than thesecond field of view. In some embodiments, the first sensor comprisespixels having a first pixel size and the second sensor comprises pixelshaving a second pixel size, wherein the first pixel size is equal to orlarger than the second pixel size. In some embodiments, combining thefirst image with the second image comprises scaling the first image by

$\frac{{the}\mspace{14mu} {first}\mspace{14mu} {pixel}{\mspace{11mu} \;}{size}}{{the}\mspace{11mu} {second}{\mspace{11mu} \;}{pixel}\mspace{14mu} {size}}.$

In some embodiments, scaling the first image utilize a cubicinterpolation algorithm or a bilinear interpolation algorithm. In someembodiments, combining the first image with the second image comprisesfusing the scaled first image and the second image. In some embodiments,the combined image is comprised wholly of fused parts when the desiredfield of view is narrower than the first field of view and the secondfield of view. In some embodiments, the combined image is comprised ofan inner field of view comprised of fused parts and an outer field ofview comprised of the first scaled image when the desired field of viewis between the first field of view and the second field of view. In someembodiments, fusing the scaled first image and the second image utilizesa Laplacian pyramid algorithm or a weighted average algorithm. In someembodiments, fusing the scaled first image and the second imagecomprises pixel fusion. In some embodiments, pixel fusion occurs forareas in which a field of view of the first scaled image and the secondscaled image overlaps. In some embodiments, the method further comprisesscaling the fused image to a desired size.

In another aspect, an imaging system for capturing images is provided.The system comprises: an optical element configured to separate lightinto a first light beam and a second light beam; a first lens moduleconfigured to focus the first light beam; a second lens moduleconfigured to focus the second light beam; a first sensor configured tocapture a first image from the first light beam focused by the firstlens module onto the first sensor, wherein the first sensor has a firstsensor size; and a second sensor configured to capture a second imagefrom the second light beam focused by the second lens module onto thesecond sensor, wherein the second sensor has a second sensor sizedifferent from the first sensor size.

In some embodiments, the first image has a first field of view and thesecond image has a second field of view different from the first fieldof view. In some embodiments, the first light beam is a reflected partof the light and the second light beam is a refracted part of the light.In some embodiments, an optical axis of the first lens module and anoptical axis of the second lens module coincide with respect to anangular bisector of a reflection angle and a refraction angle. In someembodiments, the first lens module and the second lens module haveidentical focal lengths. In some embodiments, the first sensor size islarger than the second sensor size. In some embodiments, each individualpixel on the first sensor is equal to or larger than each individualpixel on the second sensor. In some embodiments, an optical axis of thefirst lens module and an optical axis of the second lens modulecoincide. In some embodiments, the optical axis of the first lens moduleand an optical axis of the second lens module are perpendicular. In someembodiments, the light passes through a single aperture prior to contactwith the optical element. In some embodiments, a center of the firstimage and the second image coincide. In some embodiments, the opticalelement is a translucent film reflector. In some embodiments, theoptical element is a beam splitter. In some embodiments, the first lensmodule and the second lens module comprise only prime lenses. In someembodiments, the first sensor and the second sensor are of a same type.In some embodiments, the first sensor and the second sensor are of adifferent type. In some embodiments, an optical parallax is absentbetween an optical axis of the first lens module and an optical axis ofthe second lens module. In some embodiments, a parallax is absentbetween the first image and the second image. In some embodiments, thesystem further comprises one or more processors, wherein the one or moreprocessors are configured to combine the first image with the secondimage. In some embodiments, the one or more processors are configured toreceive a desired field of view and generate a combined image, and thecombined image has a combined field of view corresponding to the desiredfield of view. In some embodiments, the first image has a first field ofview and the second image has a second field of view different from thefirst field of view. In some embodiments, the desired field of view isequal to or narrower than at least one of the first field of view or thesecond field of view. In some embodiments, the first sensor size islarger than the second sensor size. In some embodiments, the first fieldof view is wider than the second field of view. In some embodiments, thefirst sensor comprises pixels having a first pixel size and the secondsensor comprises pixels having a second pixel size, wherein the firstpixel size is equal to or larger than the second pixel size. In someembodiments, the one or more processors are configured to scale thefirst image by

$\frac{{the}\mspace{14mu} {first}\mspace{14mu} {pixel}{\mspace{11mu} \;}{size}}{{the}\mspace{11mu} {second}{\mspace{11mu} \;}{pixel}\mspace{14mu} {size}}$

to generate the combined image. In some embodiments, the one or moreprocessors are configured to utilize a cubic interpolation algorithm ora bilinear interpolation algorithm to scale the first image. In someembodiments, the one or more processors are configured fuse the scaledfirst image and the second image to generate the combined image. In someembodiments, the combined image is comprised wholly of fused parts whenthe desired field of view is narrower than the first field of view andthe second field of view. In some embodiments, the combined image iscomprised of an inner field of view comprised of fused parts and anouter field of view comprised of the first scaled image when the desiredfield of view is between the first field of view and the second field ofview. In some embodiments, the one or more processors are configured toutilize a Laplacian pyramid algorithm or a weighted average algorithm tofuse the scaled first image and the second image. In some embodiments,the one or more processors are configured to fuse the scaled first imageand the second image via pixel fusion. In some embodiments, pixel fusionoccurs for areas in which a field of view of the first scaled image andthe second scaled image overlaps. In some embodiments, the one or moreprocessors are configured to scale the combined image to a desired size.

In another aspect, a movable system is provided. The movable systemcomprises: a movable platform; the imaging system previously describedherein configured to be mounted on the movable platform; and a gimbalconfigured to stabilize the imaging system.

In some embodiments, the gimbal is configured to rotate the imagingsystem with respect to the movable platform.

It shall be understood that different aspects of the invention can beappreciated individually, collectively, or in combination with eachother. Various aspects of the invention described herein may be appliedto any of the particular applications set forth below or for any othertypes of movable objects. Any description herein of aerial vehicles,such as unmanned aerial vehicles, may apply to and be used for anymovable object, such as any vehicle. Additionally, the systems, devices,and methods disclosed herein in the context of aerial motion (e.g.,flight) may also be applied in the context of other types of motion,such as movement on the ground or on water, underwater motion, or motionin space.

Other objects and features of the present invention will become apparentby a review of the specification, claims, and appended figures.

INCORPORATION BY REFERENCE

All publications, patents, and patent applications mentioned in thisspecification are herein incorporated by reference to the same extent asif each individual publication, patent, or patent application wasspecifically and individually indicated to be incorporated by reference.

BRIEF DESCRIPTION OF THE DRAWINGS

The novel features of the invention are set forth with particularity inthe appended claims. A better understanding of the features andadvantages of the present invention will be obtained by reference to thefollowing detailed description that sets forth illustrative embodiments,in which the principles of the invention are utilized, and theaccompanying drawings of which:

FIG. 1 illustrates an imaging system, in accordance with embodiments.

FIG. 2 illustrates an imaging system, in accordance with embodiments.

FIG. 3 illustrates a field of view angle of an optical lens, inaccordance with embodiments.

FIG. 4 illustrates a method for generating images, in accordance withembodiments.

FIG. 5 illustrates a flowchart for obtaining a combined image having adesired magnification, in accordance with embodiments.

FIG. 6 illustrates an image having a desired FOV less than the first FOVand the second FOV, in accordance with embodiments.

FIG. 7 illustrates an image having a desired FOV between the first FOVand the second FOV, in accordance with embodiments.

FIG. 8 illustrates a method for generating images, in accordance withembodiments.

FIG. 9 illustrates an image having a desired FOV, in accordance withembodiments.

FIG. 10 illustrates an image comprising an inner FOV comprised of fusedparts (e.g., pixel fused parts) and an outer FOV comprised of non-fusedparts, in accordance with embodiments.

FIG. 11 illustrates an unmanned aerial vehicle (UAV) carrying an imagingsystem having two or more optical modules, in accordance withembodiments.

FIG. 12 illustrates a method for generating images, in accordance withembodiments.

FIG. 13 illustrates an appearance of UAV in accordance with embodimentsof the present invention.

FIG. 14 illustrates a movable object including a carrier and a payload,in accordance with embodiments of the present invention.

FIG. 15 is a schematic illustration by way of block diagram of a systemfor controlling a movable object, in accordance with embodiments of thepresent invention.

DETAILED DESCRIPTION

A need exists for imaging systems that are able to capture high quality(e.g., high resolution) images with varying fields of views and/orvarying magnifications. In some instances, it may be beneficial for theimaging systems to be small in size (e.g., volume) and low in weight inorder for them to be incorporated into other devices (e.g., cell phones)or be coupled to movable objects (e.g., unmanned aerial vehicles).

An imaging system as described herein may acquire two or more images ofdiffering fields of views from a common line of sight. In someinstances, the imaging system may comprise two or more optical modules.In some instances, the two or more optical modules may comprise lensmodules of different focal lengths and/or sensors of different sizes, asfurther described below. The two or more images may be captured at anygiven time point. Because the two or more images are acquired from acommon line of sight, there may not be an optical parallax between theacquired images. Because the two or more images are acquired from acommon line of sight, a center of the two or more images may coincide(e.g., coincide exactly). Because the two or more images are acquiredfrom a common line of sight, there may not be an optical parallaxbetween the acquired images. The two or more images may be fused togenerate images of arbitrary magnification (e.g., arbitrary field ofview) as desired.

FIG. 1 illustrates an imaging system. The imaging system 100 may intakelight 102 and output an image 104 (e.g., on a display). The imagingsystem may comprise an optical module 104 which may include one or morelenses 106 and/or image sensors 108. A lens may be a prime lens. A primelens may have a fixed, single focal length. A lens may be a zoom lens,as further described below. An imaging system may comprise one or moresensors. For example, an imaging system may comprise a light sensor 112with photosites to collect and store photons. The light sensor mayfurther convert the collected information (e.g., photons) to a digitalform (e.g., capturing an image). For example, an imaging system maycomprise a focusing sensor 114 to determine a correct focus of an imagethat is to be captured. For example, an imaging system may comprise abalancing sensor (e.g., a white balance sensor) 116 to balance color ofa captured image (e.g., to match that of human vision). In someinstances, one image sensor 108 may comprise functions of a plurality ofsensors. For example, one sensor may be used to detect and convey lightinto a form that conveys an image (e.g., capture an image) as well asfocus and balance the image (e.g., white balance). An image processor110 may process the captured images and perform image processingfunctions such as black level correction, surrounding light ratiocorrection, distortion correction, white balance correction, colorcrosstalk correction, de-mosaic, color correction, gray scale mapping,color space conversion, sharpening, and noise removal to generate animage for viewing. The imaging system may further comprise acommunication unit 118 and/or storage unit 120. A communication unit maybe used for communication with external components and/or devices, e.g.,mobile devices such as mobile phones, tablets, PCs, remote controllers,etc. The communication unit, for example, may be used in sending imagescaptured by the imaging system (e.g., output), or receiving inputs(e.g., control signals) from the external components or devices. Thecommunication unit may also be used to transform images via digitalsignal processing (DSP) to improve captured images (e.g., by the imagesensor) in some way. The storage unit may be used for temporarily orpermanently storing image(s) captured by the imaging system.

In many instances, it may be desirable to capture (e.g., generate) highquality images using imaging systems. In many instances, it may bedesirable to provide imaging systems with a zoom capability to captureimages of an environment far away from the imaging systems. The imagingsystems may utilize an optical zooming system, a digital zooming system,a multi-lens digital zooming system, or a combination thereof.

An optical zooming system may enlarge an image with the aid of a set ofoptical lenses (e.g., zoom lens). A zoom lens may have variable focallengths and the focal length may encompass a plurality of focal lengths(e.g., focal length range). An optical zoom lens may vary the focallength by a relative movement of a set of internal lens elements.However, imaging devices having a zoom lens that cover a wide zoom rangemay be large in size, heavy in weight and expensive in cost which maynot be suitable for use when the imaging device is carried by a movableobject or wherein the imaging device is integrated as a component.

A digital zooming system may simulate an optical zooming system by usingimage processing algorithms (e.g., super-resolution algorithms) toenlarge a portion of a captured image (e.g., captured using a prime lensor a zoom lens). A digital zoom may make a captured image seem moreclose up (e.g., magnify the captured image). Digital zoom may decreasean apparent field of view. Digital zoom may crop a portion of thecaptured image and interpolate the cropped result back up to a pixeldimension of the original captured image. No optical resolution may beas a result of digital zooming. However, digital zooming may deteriorateimages above a certain zoom level (e.g., 2X) and zoom performance of adigital zooming system may be much worse than that of an optical zoomingsystem.

A multi-lens digital zooming system may capture two or more images withdiffering fields of views for any given time point (e.g., using a zoomlens or a prime lens). A multi-lens digital zooming system may capturetwo or more images with differing fields of views in the same directionfor any given time point. A multi-lens digital zooming system maycomprise two or more optical modules (e.g., two or more lens modules andtwo or more corresponding sensors). The two or more images may then befused using image processing algorithms to obtain a single image with afield of view equal to or smaller than that of the image having thelargest field of view (between the two or more images with differingfields of views). However, it may be difficult to manufacture opticalsystems in which the optical axes of the two or more lens modules areparallel and the optical centers are close. In the two or more imagescaptured images, the optical parallax may be different for differentdepths of objects which may bring computational difficulties for imagealignment and give rise to ghosting problems.

The systems and methods described herein permit generation of two ormore images. In some instances, imaging systems may be provided forgeneration of the images. The imaging systems may comprise two or moreoptical modules and an optical element. The two or more images may becaptured with two or more optical modules that are not substantiallyparallel and/or having optical centers that are not close. The two ormore optical modules may each capture images from a common line ofsight. The two or more optical modules may each capture images from aline of sight that overlaps at least partially. The imaging system maylack an optical parallax (e.g., between the two or more opticalmodules). In some instances, a center of the two or more images maycoincide. The two or more images may be combined. In some instances, itmay not be necessary to estimate a depth of objects within the two ormore images (e.g., there being no optical parallax) and accuracy ofimaging matching may increase. While the imaging systems primarilycomprise two optical modules, it is to be understood that the imagingsystems may comprise two, three, four, five or more optical modules.

FIG. 2 illustrates an imaging system 200, in accordance with embodimentsof the invention. The imaging system may be all enclosed in a singlehousing, as further described below. The imaging system may be, forexample, a camera. The imaging system may comprise a plurality ofdiscrete parts (e.g., devices) working together. For example, theimaging system may comprise two or more cameras and other opticalelements working in conjunction.

Light may enter through a single aperture 201 on the imaging system. Insome embodiments, light may enter through a plurality of apertures, suchas two, three, four, five or more apertures. Light 202 entering throughthe aperture may come into contact with an optical element 204. Theoptical element may be a beamsplitter, such as a cube beamsplitter,plate beam splitter, pellicle beamsplitter, perforated beamsplitter, andthe like. A beamsplitter may refer to an optical element or a devicethat splits a beam of light into two or more parts (e.g., two or morelight beams). In some embodiments, the optical element may be atranslucent film reflector, a prism, a translucent mirror, half-silveredmirror and the like. The optical element may be oriented such that lightcontacts the optical element at a certain incidence angle (e.g.,measured from the normal of the optical element). In some embodiments,the incidence angle may be about 15°, 30°, 45°, or 60°, 90°, 120°, or150°.

After contacting the optical element 204, the light may be separatedinto a first light beam 208 and a second light beam 210. The light maybe from a single source. The light may be a single light beam. In someinstances, a plurality of light beams may contact the optical elementand each be separated into a first light beam and a second light beam.Each of the first and second light beams may comprise the sameinformation (e.g., same light information, same photons, etc). Each ofthe first and second light beams may comprise substantially the sameinformation. Each of the first and second light beams may containdifferent information. A same image may be captured from each of thefirst and second light beams. In some embodiments, the light may beseparated into two, three, four, five or more light beams aftercontacting an optical element. The number of light beams may correspondto a number of optical modules in the imaging system. For example, if anoptical element separates light into two light beams, the imaging systemmay comprise two optical modules. For example, if an optical elementseparates light into three light beams, the imaging system may comprisethree optical modules.

In some embodiments, the optical element may both reflect and transmit(e.g., refract) light. For example, a first light beam 208 may be areflected component of light 202 and a second light beam 210 may be atransmitted component of the light 202. The reflected light beam may bereflected at a certain reflectance angle (e.g., measured from the normalof the optical element). The reflectance angle may be about 15°, 30°,45°, 60°, 90°, 120°, or 150°. The transmitted light beam may experienceno refraction during transmission through the optical element and anoptical path of light may not be affected where it is transmitted. Insome embodiments, the transmitted light beam may experience refractionduring transmission through the optical element and an optical path oflight may be affected where it is transmitted. The transmitted lightbeam may be refracted at a certain refraction angle (e.g., measured fromthe normal of the optical element). The refraction angle may be about15°, 30°, 45°, 60°, 90°, 120°, or 150°. In some embodiments, thetransmitted light and the reflected light may be at about a 30°, 60°,90°, 120°, 150°, or 180° angle relative to one another. In someembodiments, the transmitted light and the reflected light may beperpendicular (at a 90° angle) to each other. The optical element mayhave a transmission-to-reflectance (TR) ratio for light at a certainincidence angle (e.g., 45°). The TR ratio may measure the relativeintensity of light of the transmitted light to reflected light. The TRratio may be about 50/50, 40/60, 30/70, 20/80, 10/90, 90/10, 80/20,70/30, 60/40. Alternative embodiments may include multiple reflected,multiple transmitted and/or refracted light beams. In some embodiments,a plurality of beam splitters may be utilized to further separate thelight. Any description provided with respect to the optical elementherein may apply in regards to multiple reflected, multiple transmittedand/or refracted light beams. In some embodiments, the optical elementmay separate light into beams of differing wavelength (color). Forexample the optical element may comprise dichroic or trichroic prismswhich separate light into two or three colors.

A first light beam 208 may be directed and captured using a firstoptical module 212. A second light beam 210 may be directed and capturedusing a second optical module 218. Each optical module may each captureimages of an environment (e.g., near or around the imaging system). Eachoptical module may continuously capture images. Each optical module maycapture images at a specified frequency to produce a series of imagedata over time. Multiple modules of an imaging system may capture imagesat a high enough frequency to provide video-rate capturing. Images maybe captured at a rate of at least 10 Hz, 20 Hz, 30 Hz, 40 Hz, 50 Hz, 60Hz, 70 Hz, 80 Hz, 90 Hz, 100 Hz, 120 Hz, 150 Hz, 200 Hz, 250 Hz, or 300Hz.

The first optical module 212 and second optical module 218 may each havean optical axis. An optical axis may refer to a line along which thereis some degree of rotational symmetry in an optical module. The opticalaxis may be defined by a line along which light propagates through thelens module. The optical axis may pass through a center of the opticalmodule. For example, line 208 may define an optical axis of the firstoptical module and line 210 may define an optical axis of the secondoptical module. The optical axis of the first optical module and anoptical axis of the second optical module may intersect. For example,the optical axis of the first optical module and an optical axis of thesecond optical module may intersect with respect to an angular bisectorof a reflection angle and a refraction angle (e.g., of the opticalelement). In some embodiments, the optical axes of the first opticalmodule and the second optical module coincide exactly at a point 224 onthe optical element 204. For example, the optical axes of the firstoptical module and the second optical module may intersect on a surfaceof the optical element. In some embodiments, the optical axis of thefirst optical module and an optical axis of the second optical moduleare perpendicular.

An optical module may each have a line of sight. A line of sight of anoptical module may refer to a path of light coinciding with an opticalaxis of the optical module. For example, the first optical module 212may have a line of sight comprised of section 208 and section 202. Forexample, the second optical module 218 may have a line of sightcomprised of section 210 and section 202. A line of sight of the firstoptical module and the second optical module may overlap, for exampleover section 202. A line of sight of the first optical module and thesecond optical module may overlap at least partially (e.g., over section202 but not afterwards).

Each optical module may comprise a lens module and a sensor (e.g., imagesensor). For example, the first optical module 212 may comprise a firstlens module 214 to direct the reflected light beam 208 to a first imagesensor 216 that captures the reflected light beam (e.g., captures imagedata). For example, the second optical module 218 may comprise a secondlens module 220 to direct the transmitted light beam 210 to a secondimage sensor 222 that captures the transmitted light beam. Each of thelens modules may comprise one or more lenses. The lens module maycomprise a lens barrel configured to receive the one or more lenses. Thelens barrel may house the one or more lenses. In some instances, thelens barrel may be used to adjust a focal length of the lens module byadjusting a distance between the one or more lenses. The lens may beconfigured to direct light to the image sensor. Optionally, otheroptical elements, such as mirrors, filters, gratings, additional lenses,or dichroics, may be provided that may aid in directing light to theimage sensor. Alternatively, no lens or optical elements may beprovided.

Each lens (e.g., or lens module, or optical module) may have acorresponding focal length or a focal length range. A focal length rangemay include multiple focal lengths falling within a lower limit and anupper limit of the range. In some instances, a focal length range mayinclude a single focal length. The single focal length may serve as boththe lower limit and the upper limit of the range. As used herein, it isto be understood that focal length and focal length range may be usedinterchangeably. A focal length of a lens may measure how strongly thelens converges or diverges light. The focal length of an optical lensmay refer to the distance over which initially collimated rays arebrought to a focus. A lens may be a prime lens or a zoom lens. A primelens may have a fixed, single focal length. A prime lens may refer to astationary lens that does not move. A zoom lens may have variable focallengths and the focal length may encompass a plurality of focal lengths(e.g., focal length range). An optical zoom lens may vary the focallength by a relative movement of a set of internal lens elements. Insome embodiments, the imaging system may comprise only prime lenses. Forexample, optical module 212 and optical module 218 may comprise onlyprime lenses. In some embodiments, the imaging system may comprise botha prime lens and a zoom lens. For example, one optical module maycomprise a prime lens while another optical module comprises a zoomlens. In some embodiments, the imaging system may comprise only zoomlenses.

The focal length of each optical module of the imaging system may bedifferent. For instance, each optical module of the imaging system maycomprise prime lenses having different focal lengths. For example, thefirst optical module 212 may have a first focal length that is differentfrom a second focal length of the second optical module 218. Forexample, optical module 212 may have a first focal length based on afirst prime lens, and optical module 218 may have a second focal lengthbased on a second prime lens. The first optical module may have a focallength that is greater than 25%, 50%, 75%, 100%, 125%, 150%, 200%, 300%,400%, 500%, or 1000% of the second optical module. The first opticalmodule may have a focal length that is less than 25%, 50%, 75%, 100%,125%, 150%, 200%, 300%, 400%, 500%, or 1000% of the second opticalmodule. Additionally, there may be a third optical module (e.g., orfourth, fifth, sixth, etc) having a focal length different from thefirst focal length range and/or the second focal length range, and soforth. In some embodiments, the focal length of each optical module ofthe imaging system may be the same. For example, optical module 212 mayhave a focal length that is the same as focal length of optical module218.

In some instances, a focal length of a prime lens may be less than orequal to 1 mm, 2 mm, 4 mm, 6 mm, 5 mm, 6 mm, 8 mm, 10 mm, 12 mm, 14 mm,16 mm, 18 mm, 20 mm, 22 mm, 24 mm, 26 mm, 28 mm, 30 mm, 35 mm, 40 mm, 45mm, 50 mm, 55 mm, 60 mm, 65 mm, 70 mm, 75 mm, 80 mm, 85 mm, 90 mm, 95mm, 100 mm, 105 mm, 110 mm, 120 mm, 130 mm, 140 mm, 150 mm, 160 mm, 170mm, 180 mm, 190 mm, 200 mm, 220 mm, 240 mm, 260 mm, 280 mm, 300 mm, 320mm, 340 mm, 360 mm, 380 mm, 400 mm, 450 mm, 500 mm, 550 mm, 600 mm, 650mm, 700 mm, 750 mm, 800 mm, 850 mm, 900 mm, 950 mm, 1000 mm, 1150 mm, or1200 mm. Optionally, the focal length of a prime lens suitable may begreater than or equal to any of the values described herein. The focallength of a prime lens may have a value falling within a range betweenany two of the values described herein.

Each optical module of the imaging system may comprise an image sensor.Image sensor as used herein may also be referred to as a sensor. Thelight focused by the lens may be directed onto the image sensor of theoptical module. The image sensor may be at a predetermined distance awayfrom the lens module. For example, the distance from the image sensor tothe lens module may correspond to the focal length of the lens module.In some instances, the image sensor may have a variable distance to thelens module (e.g., zoom lens). The image sensor may be positioned suchthat a focal plane of the captured image is coplanar with the imagesensor plane.

The image sensor may refer to a device that converts optical information(e.g., light striking the sensor surface may comprise opticalinformation) into digital information (e.g., electronic signals).Converting optical information into digital information may herein bereferred to as capturing an image (e.g., image data). An image sensormay detect and convey information that constitutes an image. The imagesensors may be of a charge-coupled devices (CCD) type, a complementarymetal-oxide-semiconductor (CMOS) type, an N-typemetal-oxide-semiconductor (NMOS) type, or a back-side illuminated CMOS(BSI-CMOS) type. Each optical module of an imaging system may have thesame type of image sensor, or different types of image sensors. Theimage sensors may have the same characteristics or may have differentcharacteristics. For example, the image sensors may be capable ofcapturing an image of the same resolution, or may have differentresolutions at which images can be captured. For instance, one of theimage sensors may permit a resolution of 25%, 50%, 75%, 100%, 125%,150%, 200%, 300%, 400%, 500%, or 1000% of other image sensors. Eachimage sensor may have a sensor size. The sensor size (e.g., physicalsize) of the two or more image sensors (e.g., in the imaging system) maybe the same. For example, first sensor 216 and second sensor 222 mayhave the same size. In some embodiments, the sensor size of the two ormore image sensors (e.g., in the imaging system) may be different. Forexample, a sensor size of a given image sensor may be 25%, 50%, 75%,100%, 125%, 150%, 200%, 300%, 400%, 500%, or 1000% in size of any otherimage sensor (e.g., in the imaging system). Each image sensor may have aset number of pixels. For example the image sensor may have about 1, 2,3, 4, 5, 6, 8, 10, 12, 14, 16, 18, 20, 25, 30, 35, 40, 50, 60, 70, 80,90, or 100 megapixels. Each image sensor in the imaging system may havethe same number of pixels. For example, first sensor 216 and secondsensor 222 may each have the same number of pixels. In some embodiments,the number of pixels of the two or more image sensors (e.g., in theimaging system) may be different. For example, a pixel number of a givenimage sensor may be 25%, 50%, 75%, 100%, 125%, 150%, 200%, 300%, 400%,500%, or 1000% of any other image sensor (e.g., in the imaging system).Each pixel for a given image sensor may have a pixel size. Each imagesensor in the imaging system may have the pixels of the same size. Forexample, first sensor 216 and second sensor 222 may each have pixels ofthe same size. In some embodiments, a pixel size of the two or moreimage sensors (e.g., in the imaging system) may be different. Forexample, a pixel size of a given image sensor may be 25%, 50%, 75%,100%, 125%, 150%, 200%, 300%, 400%, 500%, or 1000% in size of any otherimage sensor's pixel size (e.g., in the imaging system). The number ofpixels in an image sensor may determine a physical size of a generatedimage. The image sensors may use the same amount of processing power, ormay use different amounts of processing power. The image sensors of thedifferent optical modules may consume the same amount of power or mayconsume different amounts of power.

Each optical module may have a field of view (FOV) associated with it.Each optical module in the imaging system may have a different FOV. Eachoptical module in the imaging system may have identical (e.g., same)fields of views. The fields of views of the optical modules in theimaging system may overlap. A FOV of an optical module may encompass aFOV of a different optical module in the imaging system. A FOV may referto a part of the world that is visible on an imaging system at aparticular position and orientation in space. Objects outside the FOVwhen an image is taken may not be recorded in a photograph. FOV may alsobe expressed as an angular size of the view cone, or as an angle ofview. A FOV of an optical module may depend on the sensor size and thefocal length. FIG. 3 illustrates field of view angle of an optical lens300, in accordance with embodiments of the invention. For the opticallens, the field of view angle α can be calculated as FOV α=2 arctan(d/2f), where d is image sensor size, and f is focal length of the lens.

For an image sensor having a fixed size, a prime lens (e.g., lensmodule, optical module) may have a fixed FOV and the FOV may encompass asingle FOV angle. For an image sensor having a fixed size, a zoom lens(e.g., lens module, optical module) may have variable FOV angular rangeand the FOV angular range may encompass a plurality of FOV angles. TheFOV of the first optical module 212 may be different from the FOV of thesecond optical module 218. The FOV may depend on one or more lenses orother optical elements (e.g., sensor) of the optical modules. Forexample, the difference in FOV between the first optical module and thesecond optical module may be due to differences in a first lens module214 and a second lens module 220. For example, the difference in FOVbetween the first optical module and the second optical module may bedue to differences in the first sensor 216 and the second sensor 222.For example, the difference in FOV between the first optical module andthe second optical module may be due to differences between the firstlens module and the second lens module as well as differences betweenthe first sensor and the second sensor. In some instances, a FOV of aprime lens may (e.g., lens module, optical module) be less than or equalto 180°, 170°, 169°, 165°, 160°, 155°, 150°, 145°, 140°, 135°, 130°,125°, 120°, 115°, 110°, 105°, 100°, 95°, 90°, 85°, 80°, 75°, 70°, 65°,60°, 55°, 50°, 45°, 40°, 35°, 30°, 25°, 20°, or 15°. Optionally, the FOVof a prime lens (e.g., lens module, optical module) may be greater thanor equal to any of the values described herein. The FOV of a prime lensmay have a value falling within a range between any two of the valuesdescribed herein.

The first optical module and the second optical module may be configuredto capture images from the same direction. In some embodiments, opticalaxes of the first optical module and the second optical module maycoincide or intersect, for example, at a point 224. In some embodiments,optical axes of the first optical module and the second optical modulemay be perpendicular. In some embodiments, optical axes of the firstoptical module and the second optical module may diverge by at mostabout 30 degrees, 45 degrees, 60 degrees, 75 degrees, 90 degrees, 120degrees, or 150 degrees. In some embodiments, optical axes of the firstoptical module and the second optical module may diverge by at leastabout 30 degrees, 45 degrees, 60 degrees, 75 degrees, 90 degrees, 120degrees, or 150 degrees. In some embodiments, optical axes of the firstoptical module and the second optical module may diverge in betweenabout 30 degrees, 45 degrees, 60 degrees, 75 degrees, 90 degrees, 120degrees, or 150 degrees. There may be no optical parallax between animage captured by the first optical module and the second opticalmodule. For example, there may be no optical parallax because the firstoptical module and the second optical module may each capture imagesfrom a common line of sight (e.g., from a line of sight that overlaps atleast partially). A center of an image captured by the first opticalmodule and the second optical module may coincide (e.g., coincideexactly). A FOV of an image captured by the first optical module and thesecond optical module may overlap. The image captured by the firstoptical module and the second optical module may be images captured fromthe same direction and/or same angle. The image captured by the firstoptical module and the second optical module may be images captured fromthe same originating light (e.g., light beams).

An image processor 226 may be provided to receive image data from thefirst optical module 212 and/or the second optical module 218 andgenerate data to display at least one image captured using the firstoptical module and/or the second optical module. In some embodiments,the image processor may combine the image captured from the firstoptical module and the second optical module to generate a combinedimage. In some embodiments, the image processor may be provided onboarda movable object, such as a UAV or a mobile phone. In some embodiments,the image processor may be provided on board an imaging system (e.g.,camera) of the movable object. The image processor may be within oroutside a housing of the imaging system. In some instances, the imageprocessor may be provided off-board the imaging system of the movableobject. The image processor may be provided on a carrier, such as agimbal, further described below. Alternatively, the image processor maybe provided remote to the movable object. For instance, the imageprocessor may be provided on a remote controller (e.g., cell phone, PDA,etc), server, ground station (e.g., desktop computer, laptop, chargingstation, etc), or cloud-based infrastructure. Information from one ormore optical modules may be wirelessly transmitted to the imageprocessor. Alternatively, information from the optical modules may beprovided to the image processor via a physical connection. The imageprocessor 226 may be implemented by a Central Processing Unit (CPU),Application Specific Integrated Circuit (ASIC), or Field ProgrammableGate Array (FPGA). Any description herein of a processor may apply toone or more processors, which may individually or collectively performany functions described for the image processor. The image processor mayinclude a single or multiple processors. The image processor may becapable of executing one or more steps in accordance with non-transitorycomputer readable media comprising code, logic, or instructions forperforming one or more steps. Memory storage units may be provided whichmay comprise the non-transitory computer readable media.

In some instances, the image processor may receive a desired FOV (e.g.,a desired focal length, a desired magnification, a desired zoom, adesired direction, etc). The desired FOV may be received, for example,from a user. For instance, an instruction of a desired FOV may bereceived from the user through a remote terminal. The user may select adesired FOV and send the instruction of a FOV by operating buttonsprovided on the remote terminal or by touching soft buttons displayed ona screen of the remote terminal. In some instances, a user may observe adisplay showing an environment that is to be captured by the imagingsystem (e.g., in real time). The user may increase or decrease the FOV(e.g., focal length, zoom ratio, etc) of the environment in the display(e.g., via touchscreen interface, physical buttons, etc) that is to becaptured by the imaging system. Once a user confirms the FOV that is tobe captured by the imaging system (e.g., by pushing the display screenor a button), the desired FOV may be received by the image processor. Insome embodiments, the image processor may be configured to receive imagedata from the first optical module and the second optical module andstore the image data in corresponding buffers. In some instances, theimage data may be read from the corresponding buffers and processedaccording to an external instruction of a desired FOV. In someinstances, the desired FOV may be a required input before any imagecapture by the imaging system. In some instances, the desired FOV may beinput subsequently to image capture by the imaging system, or may beupdated at any time during image capture by the imaging system.

In some instances, the desired FOV may be determined by one or moreprocessors. In some instances, the one or more processors may determinethe desired FOV (e.g., by analyzing the image of the environment to becaptured). The one or more processors may determine the desired FOVautomatically without any human input. In some instances, the one ormore processors may determine the desired FOV semi-automatically, forexample, according to a set criterion pre-input by a user. In someinstances, the one or more processors may determine or control externalfactors to affect the FOV of the images to be captured. For example, theone or more processors may affect a direction or orientation of acarrier (e.g., gimbal) or movable object (e.g., UAV) coupled with theimaging system. In some instances, the desired FOV may equal the widerFOV between the FOV of the first optical module and the second opticalmodule.

Based on the desired FOV, the image processor may combine the image datareceived from optical module 212 and optical module 218, as furtherdescribed herein. In some instances, combining the image data (e.g.,received from two or more optical modules) may comprise scaling and/orfusing the image data. Scaling images (e.g., image data) may be usedherein to refer to increasing or decreasing a size of the images (e.g.,magnifying the image, scaling each pixel in an image by a factor).Fusing two or more images (image data) may be used herein to refer tocombining parts of two or more images to generate a single image (e.g.,with a better image quality than either of the individual images). Thesingle image that is generated (e.g., fused) may be seamlesslyintegrated (e.g., at the borders).

Images captured by optical module 212, optical module 218, or thecombined image may be shown on a display. The images may be shown on thedisplay in real time. The display may be a device appropriate fordisplaying images or videos, for example, a LCD (Liquid CrystalDisplay), a CRT (Cathode Ray Tube), an OLED (Organic Light EmittingDiodes), or a Plasma. The display may be configured to show the imagescaptured by the first optical module 212 and/or the second opticalmodule 218. The display may be configured to show a combined imagegenerated by the processor 226. The display may display the image basedon the image data generated by the image processor. In some embodiments,the display may be a local display device of the imaging system 200. Insome instances, the display may be provided on a movable object or thestationary object carrying the imaging system. In some instances, thedisplay may be provided on a mobile device, such as a cellphone, PDA,tablet, or controller. Alternatively, the display may be a displaydevice remote to the imaging system 200. In some instances, the displaymay be a remote terminal such as a smartphone, a tablet, a laptop or apersonal computer, which receives the image data from the imaging systemvia a wireless link. The wireless link between the imaging system andthe display may be a RF (radio frequency) link, a Wi-Fi link, aBluetooth link, a 3G link, or a LTE link.

The display may also function as an input device for receiving a user'sinstruction with regard to the images (e.g., to be captured and orgenerated). In some instance, the display may be an interactive screen,by which the user may select a desired focal length, desiredmagnification, desired field of view, etc of the environment to be shownon the display. The display may be a touchscreen. Alternatively, theuser may interact with the display using any user interactive device,such as a mouse, keyboard, joystick, trackball, touchpad, or microphone.

An imaging system may have a housing. Multiple optical modules of theimaging system may be provided within a single housing. Alternatively,different optical modules may be provided in different housings. In oneexample, a first optical module and a second optical module may beprovided in one housing and thus share the housing. Alternatively, thefirst optical module and second optical module may be provided indifferent housings. A housing may encapsulate one, two or more opticalmodules. In some embodiments, a housing may be substantiallyfluid-tight. The housing may be air-tight. The housing may be formedfrom a substantially opaque material, translucent material, ortransparent material. The housing may prevent unwanted light fromentering the housing. The housing may limit light reaching the opticalmodules to one or more controlled entrances. The housing may belight-tight, except for a single aperture located on the housing. Insome embodiments, multiple optical modules of an imaging system may besupported by a single housing. The optical modules may be within thehousing, on an exterior of a housing, or at least partially embedded ina housing. The housing may cause the optical modules to move together.For instance, the optical modules may be movable as a single unit. Theoptical modules may rotate together about one or more axes, or maytranslate together along one or axes. In some instances, the opticalmodules may be movable relative to one another within the housing. Forexample, each individual optical element may be able to translaterelative to another along one or more axes within the housing or may beable to rotate relative to one another.

FIG. 4 illustrates a method for generating images, in accordance withembodiments. In step 402, light is separated into a first light beam anda second light beam with aid of an optical element. The light may befrom a single source. The light may be a single light beam. In someinstances, a plurality of light beams may contact the optical elementand each be separated into a first light beam and a second light beam.In some instances, the light (e.g., a plurality of light beams) mayenter through a single aperture, as previously described herein. Theoptical element may be substantially as described herein (e.g., a beamsplitter, a translucent film reflector, a prism, a translucent mirror,half-silvered mirror and the like). The first light beam may be areflected component of the light and the second light beam may be atransmitted component of the light. In some embodiments, the first lightbeam may be a transmitted component of the light and the second lightbeam may be a reflected component of the light.

In step 404, the first light beam is focused with aid of a first lensmodule. The first light beam may be directed to (e.g., focused onto) afirst sensor with aid of the first lens module. The first lens modulemay comprise at least one lens. In some embodiments, the first lensmodule comprises a lens barrel configured to receive the at least onelens. In some embodiments, the first lens module comprises only primelenses. In some embodiments, the first lens module may have a firstfocal length. The first focal length may be focal length may be lessthan or equal to 1 mm, 2 mm, 4 mm, 6 mm, 5 mm, 6 mm, 8 mm, 10 mm, 12 mm,14 mm, 16 mm, 18 mm, 20 mm, 22 mm, 24 mm, 26 mm, 28 mm, 30 mm, 35 mm, 40mm, 45 mm, 50 mm, 55 mm, 60 mm, 65 mm, 70 mm, 75 mm, 80 mm, 85 mm, 90mm, 95 mm, 100 mm, 105 mm, 110 mm, 120 mm, 130 mm, 140 mm, 150 mm, 160mm, 170 mm, 180 mm, 190 mm, 200 mm, 220 mm, 240 mm, 260 mm, 280 mm, 300mm, 320 mm, 340 mm, 360 mm, 380 mm, 400 mm, 450 mm, 500 mm, 550 mm, 600mm, 650 mm, 700 mm, 750 mm, 800 mm, 850 mm, 900 mm, 950 mm, 1000 mm,1150 mm, or 1200 mm. In some embodiments, the first lens modulecomprises a telescope lens module. A telescope lens module may have afocal length that is substantially larger than a focal length of anormal lens for a given film plane. For example, a telescope lens modulemay have a focal length that is about or greater than 20 mm, 22 mm, 24mm, 26 mm, 28 mm, 30 mm, 35 mm, 40 mm, 45 mm, 50 mm, 55 mm, 60 mm, 65mm, 70 mm, 75 mm, 80 mm, 85 mm, 90 mm, 95 mm, 100 mm, 105 mm, 110 mm,120 mm, 130 mm, 140 mm, 150 mm, 160 mm, 170 mm, 180 mm, 190 mm, 200 mm,220 mm, 240 mm, 260 mm, 280 mm, 300 mm, 320 mm, 340 mm, 360 mm, 380 mm,400 mm, 450 mm, 500 mm, 550 mm, 600 mm, 650 mm, 700 mm, 750 mm, 800 mm,850 mm, 900 mm, 950 mm, 1000 mm, 1150 mm, or 1200 mm. In someembodiments, the telescope lens module may direct and/or focus areflected component of the light.

In step 406, the second light beam is focused with aid of a second lensmodule. The second light beam may be directed to (e.g., focused onto) asecond sensor with aid of the second lens module. The second lens modulemay comprise at least one lens. In some embodiments, the second lensmodule comprises a lens barrel configured to receive the at least onelens. In some embodiments, the second lens module comprises only primelenses. In some embodiments, the second lens module may have a secondfocal length. The second focal length may be different from the firstfocal length. For example, the second focal length may be less than thefirst focal length. The second focal length may be greater than thefocal length. The second focal length may be focal length may be lessthan or equal to 1 mm, 2 mm, 4 mm, 6 mm, 5 mm, 6 mm, 8 mm, 10 mm, 12 mm,14 mm, 16 mm, 18 mm, 20 mm, 22 mm, 24 mm, 26 mm, 28 mm, 30 mm, 35 mm, 40mm, 45 mm, 50 mm, 55 mm, 60 mm, 65 mm, 70 mm, 75 mm, 80 mm, 85 mm, 90mm, 95 mm, 100 mm, 105 mm, 110 mm, 120 mm, 130 mm, 140 mm, 150 mm, 160mm, 170 mm, 180 mm, 190 mm, 200 mm, 220 mm, 240 mm, 260 mm, 280 mm, 300mm, 320 mm, 340 mm, 360 mm, 380 mm, 400 mm, 450 mm, 500 mm, 550 mm, 600mm, 650 mm, 700 mm, 750 mm, 800 mm, 850 mm, 900 mm, 950 mm, 1000 mm,1150 mm, or 1200 mm.

In some embodiments, the second lens module comprises a wide-angled lensmodule. A wide-angled lens module may have a focal length that issubstantially smaller than a focal length of a normal lens for a givenfilm plane. For example, a wide-angled lens module may have a focallength that is about or less than 1 mm, 2 mm, 4 mm, 6 mm, 5 mm, 6 mm, 8mm, 10 mm, 12 mm, 14 mm, 16 mm, 18 mm, 20 mm, 22 mm, 24 mm, 26 mm, 28mm, 30 mm, 35 mm, 40 mm, 45 mm, 50 mm, 55 mm, 60 mm, 65 mm, 70 mm, 75mm, 80 mm, 85 mm, 90 mm, 95 mm, 100 mm. In some embodiments, thewide-angled lens module may direct and/or focus a transmitted componentof the light (e.g., light that is transmitted through the opticalelement).

The optical axis of the first lens module and an optical axis of thesecond lens module may intersect. For example, the optical axis of thefirst lens module and an optical axis of the second lens module mayintersect with respect to an angular bisector of a reflection angle anda refraction angle (e.g., of the optical element). In some embodiments,the optical axes of the first lens module and the second lens modulecoincide exactly at a point on the optical element. For example, theoptical axes of the first lens module and the second lens module mayintersect on a surface of the optical element. In some embodiments, theoptical axis of the first lens module and an optical axis of the secondlens module are perpendicular.

In step 408, a first image (e.g., image data) is captured from the firstlight beam focused onto the first sensor. The first sensor may aid incapturing the first image, as previously described herein (e.g., byconverting optical information into digital information). The firstsensor may be a CMOS sensor, CCD sensor, NMOS sensor, BSI-CMOS sensor aspreviously described herein. The first sensor may have certaincharacteristics associated with it. For example, the first sensor mayhave a predetermined size, pixel size, number of pixels, etc aspreviously described herein. The first image may have a first field ofview. In some instances, the first field of view may be less than orequal to 180°, 170°, 169°, 165°, 160°, 155°, 150°, 145°, 140°, 135°,130°, 125°, 120°, 115°, 110°, 105°, 100°, 95°, 90°, 85°, 80°, 75°, 70°,65°, 60°, 55°, 50°, 45°, 40°, 35°, 30°, 25°, 20°, or 15°.

In step 410, a second image (e.g., image data) is captured from thesecond light beam focused onto the second sensor. The second sensor mayaid in capturing the second image, as previously described herein (e.g.,by converting optical information into digital information). The secondsensor may be a CMOS sensor, CCD sensor, NMOS sensor, BSI-CMOS sensor aspreviously described herein. In some instances, both the first sensorand the second sensor may be a CMOS sensor. The second sensor may havecertain characteristics associated with it. For example, the secondsensor may have a predetermined size, pixel size, number of pixels, etcas previously described herein. The second sensor may have the samecharacteristics as the first sensor. For example, the first sensor andthe second sensor may have identical sizes (e.g., physical size), thesame number of pixels, and/or the size of each pixel on the first sensorand the second sensor may be identical. The second image may have asecond field of view. In some instances, the second field of view may beless than or equal to 180°, 170°, 169°, 165°, 160°, 155°, 150°, 145°,140°, 135°, 130°, 125°, 120°, 115°, 110°, 105°, 100°, 95°, 90°, 85°,80°, 75°, 70°, 65°, 60°, 55°, 50°, 45°, 40°, 35°, 30°, 25°, 20°, or 15°.The second field of view may be different from the first field of view.For example, the second field of view may be about 25%, 50%, 75%, 100%,125%, 150%, 200%, 300%, 400%, 500%, or 1000% of the first field of view.In some instances, the second field of view may be of a FOV that iswider than the first field of view. The second image may have a centerthat coincides with the first image. The second image may have an imagesize that is the same as the first image (e.g., the number of pixels ofthe first sensor and the second sensor are identical). In someembodiments, the second image may be encompassed by the first image interms of FOV. There may be no parallax between the first image and thesecond image. For example, there may be no displacement or difference inthe apparent position of objects within the first image and the secondimage.

Method 400 may further comprise combining, with aid of one or moreprocessors, the first image and the second image. Combining the firstimage and the second image may comprise scaling the first image by

$\frac{{the}\mspace{14mu} {desired}\mspace{14mu} {focal}{\mspace{11mu} \;}{length}}{{the}\mspace{14mu} {first}{\mspace{11mu} \;}{focal}\mspace{14mu} {length}}$

and the second image by

$\frac{{the}\mspace{14mu} {desired}\mspace{14mu} {focal}{\mspace{11mu} \;}{length}}{{the}{\; \mspace{11mu}}{second}{\mspace{11mu} \;}{focal}\mspace{14mu} {length}}.$

Scaling the first image and/or the second image may utilize a cubicinterpolation algorithm or a bilinear interpolation algorithm. A scaledimage may have a desired magnification (e.g., desired zoom). Forexample, the first scaled image and the second scaled image may have thesame relative magnification. For example, the relative size of objectswithin the first scaled image and the second scaled image may be thesame.

Combining the first image and the second image may comprise fusing thescaled first image and the scaled second image. For example, the scaledfirst image and the scaled second image may be fused in areas in which afield of view of the first scaled image and the second scaled imageoverlaps. Portions of the scaled second image may be utilized for areasin which a field of view of the first scaled image and the second scaledimage do not overlap if necessary, as described further below. Forexample, the scaled first image and the scaled second image may bealigned (e.g., at the center). The scaled second image may encompass thescaled first image. The aligned scaled first image and the scaled secondimage may comprise an overlapping region and a non-overlapping region.For example, the entirety of the scaled first image and an inner portionof the scaled second image may comprise the overlapping region. An outerportion of the scaled second image may comprise the non-overlappingregion. The scaled first image and the scaled second image may be fusedusing a Laplacian pyramid algorithm or a weighted average algorithm. Insome embodiments, fusing the scaled first image and the scaled secondimage may comprise pixel fusion. For example, pixel fusion may occur forareas in which a field of view of the first scaled image and the secondscaled image overlaps. A fused image may have a better quality image inthe overlapping region compared to the scaled first image or the scaledsecond image. A better quality image as used herein may refer to animage having a higher resolution or more information than another image.

FIG. 5 illustrates a flowchart 500 for obtaining a combined image havinga desired magnification, in accordance with embodiments. Flowchart 500may be used, for example in combining the first image and the secondimage as described in relation to step 410. In some embodiments, adesired focal length may be received at the one or more processors. Thedesired focal length may correspond to a desired field of view, adesired magnification, a desired zoom, and the like. For example, thedesired focal length may be input by a user or determined automaticallyor semi-automatically as previously described herein. The desired focallength may be equal to or greater than at least one of the first focallength or the second focal length. If the desired focal length isgreater than both the first focal length and the second focal length,the corresponding desired field of view may be narrower than both thefirst field of view (e.g., FOV of the first image) and the second fieldof view (e.g., FOV of the second image). If the desired focal length isbetween the first focal length and the second focal length, thecorresponding desired field of view may be between the first field ofview and the second field of view. If the desired focal length isbetween the first focal length and the second focal length, thecorresponding desired field of view may be wider than the first field ofview (e.g., corresponding to an image acquired with a telescope opticallens module) but narrower than the second field of view (e.g.,corresponding to an image acquired with a wide-angled lens module).

In step 502, the desired focal length f is compared to the focal lengthfw of the wide-angled lens module (e.g., the lens module having theshorter focal length). The desired focal length f may be limited to onlyallow inputs that are equal to or greater than at least one of the firstfocal length or the second focal length (e.g., fw and ft). If a focallength shorter than the focal length of the wide-angled lens module fwis selected, an error message may be output (e.g., on a display) toinform the user.

In step 504, a determination is made whether the desired focal length fis greater than the focal length ft of the telescope lens module (e.g.,lens module having the greater focal length). If the desired focallength f is greater than the focal length ft of the telescope lensmodule, only the image generated by the optical module having thegreater focal length (e.g., telescope lens module) may be utilized ingenerating a desired image (e.g., image having the desired focallength). For example, the first image generated by telescope lens modulemay be scaled by

$\frac{{the}\mspace{14mu} {desired}\mspace{14mu} {focal}{\mspace{11mu} \;}{length}}{{the}\mspace{14mu} {first}{\mspace{11mu} \;}{focal}\mspace{14mu} {length}}$

and cropped to simulate the image having the desired focal length (e.g.,digital zoom). In some embodiments, if the desired focal length isgreater than the focal length of the telescope lens module, the scaledfirst image and the scaled second image may be fused to generate animage as previously described herein (e.g., seamlessly fused). The fusedimage may be cropped such that the FOV of the combined image iscomprised wholly of the fused parts (e.g., pixel fused parts). If thedesired focal length is smaller than the focal length of the telescopelens module, the scaled first image and the scaled second image may befused to generate a combined image as previously described herein. Thefused image may be cropped such that the FOV of the combined image iscomprised of an inner FOV comprised of the fused parts (e.g., pixelfused parts) and an outer FOV comprised of the scaled second image(e.g., image with the larger FOV). The combined image may have a fieldof view corresponding to the desired focal length.

FIG. 6 illustrates an image having a desired FOV greater than the firstand second focal lengths, in accordance with embodiments. A desiredfocal length may be received at one or more processors. In someinstances, a first image may be acquired using a first lens module and afirst sensor and a second image may be acquired using a second lensmodule and a second sensor. In some instances, the first lens module maybe a telescope lens module and the second lens module may be awide-angled lens module. In some embodiments, the first sensor and thesecond sensor may be of the same type (e.g., CMOS sensor) and may haveidentical characteristics, such as the same sensor size, have the samenumber of pixels, and/or have the same pixel size. The first image maybe scaled by

$\frac{{the}\mspace{14mu} {desired}\mspace{14mu} {focal}{\mspace{11mu} \;}{length}}{{the}\mspace{14mu} {first}{\mspace{11mu} \;}{focal}\mspace{14mu} {length}}$

and the second image may be scaled by

$\frac{{the}\mspace{14mu} {desired}\mspace{14mu} {focal}{\mspace{11mu} \;}{length}}{{the}{\; \mspace{11mu}}{second}{\mspace{11mu} \;}{focal}\mspace{14mu} {length}}$

as previously described herein.

The desired focal length may be greater than a focal length of the firstlens module (e.g., telescope lens module). For example, image 602 mayrepresent an image having a desired focal length (e.g., an image havinga desired field of view, image having a desired magnification, etc). Thefield of view of an image having a focal length greater than the focallength of the first lens module may have a field of view narrower thaneither the first field of view or the second field of view. Image 604may represent a scaled first image and image 606 may represent a scaledsecond image. When aligned, the scaled first image and the scaled secondimage may have a common center 605. When aligned, the scaled first imageand the scaled second image may have an overlapping portion defined bythe field of view of the scaled first image. Image 602 may be generatedby fusing image 604 and image 606. The fused image may be seamlesslyintegrated. The fused image may be cropped to generate the image 602having a desired focal length. The image 602 having a desired focallength may comprise only of fused parts (e.g., pixel fused parts fromthe overlap portion of the scaled first image and the scaled secondimage).

FIG. 7 illustrates an image having a desired FOV between the first andsecond focal lengths, in accordance with embodiments. The desired focallength may be greater than a focal length of the second lens module(e.g., wide-angled lens) but less than a focal length of the first lensmodule (e.g., telescope lens module). For example, image 704 mayrepresent an image having a desired focal length (e.g., an image havinga desired field of view, image having a desired magnification, etc). Thefield of view of an image having a focal length between the focal lengthof the first lens module and the focal length of the second lens modulemay have a field of view narrower than the second field of view butwider than the first field of view. Image 702 may represent a scaledfirst image and image 706 may represent a scaled second image. Whenaligned, the scaled first image and the scaled second image may have acommon center 705. When aligned, the scaled first image and the scaledsecond image may have an overlapping portion defined by the field ofview of the scaled first image. Image 704 may be generated by fusingimage 702 and image 706. The fused image may be seamlessly integrated.The fused image may be cropped to generate the image 704 having adesired focal length. The image 704 having a desired focal length maycomprise an inner FOV (e.g., inner portion) comprised of the fused parts(e.g., pixel fused parts) and an outer FOV (e.g., outer portion)comprised of the scaled second image (e.g., image with the larger FOV).

FIG. 8 illustrates a method for generating images, in accordance withembodiments. In step 802, light is separated into a first light beam anda second light beam with aid of an optical element. The light may befrom a single source. The light may be a single light beam. In someinstances, a plurality of light beams may contact the optical elementand each be separated into a first light beam and a second light beam.In some instances, the light (e.g., a plurality of light beams) mayenter through a single aperture, as previously described herein. Theoptical element may be substantially as described herein (e.g., a beamsplitter, a translucent film reflector, a prism, a translucent mirror,half-silvered mirror and the like). The first light beam may be areflected component of the light and the second light beam may be atransmitted component of the light. In some embodiments, the first lightbeam may be a transmitted component of the light and the second lightbeam may be a reflected component of the light.

In step 804, the first light beam is focused with aid of a first lensmodule. The first light beam may be directed to (e.g., focused onto) afirst sensor with aid of the first lens module. The first lens modulemay comprise at least one lens. In some embodiments, the first lensmodule comprises a lens barrel configured to receive the at least onelens. In some embodiments, the first lens module comprises only primelenses. In some embodiments, the first lens module may have a firstfocal length. The first focal length may be focal length may be lessthan or equal to 1 mm, 2 mm, 4 mm, 6 mm, 5 mm, 6 mm, 8 mm, 10 mm, 12 mm,14 mm, 16 mm, 18 mm, 20 mm, 22 mm, 24 mm, 26 mm, 28 mm, 30 mm, 35 mm, 40mm, 45 mm, 50 mm, 55 mm, 60 mm, 65 mm, 70 mm, 75 mm, 80 mm, 85 mm, 90mm, 95 mm, 100 mm, 105 mm, 110 mm, 120 mm, 130 mm, 140 mm, 150 mm, 160mm, 170 mm, 180 mm, 190 mm, 200 mm, 220 mm, 240 mm, 260 mm, 280 mm, 300mm, 320 mm, 340 mm, 360 mm, 380 mm, 400 mm, 450 mm, 500 mm, 550 mm, 600mm, 650 mm, 700 mm, 750 mm, 800 mm, 850 mm, 900 mm, 950 mm, 1000 mm,1150 mm, or 1200 mm. In some embodiments, the first lens modulecomprises a wide-angled lens module or a telescope lens module,substantially as described herein.

In step 806, the second light beam is focused with aid of a second lensmodule. The second light beam may be directed to (e.g., focused onto) asecond sensor with aid of the second lens module. The second lens modulemay comprise at least one lens. In some embodiments, the second lensmodule comprises a lens barrel configured to receive the at least onelens. In some embodiments, the second lens module comprises only primelenses. In some embodiments, the second lens module may have a secondfocal length. The second focal length may be the same as the first focallength. The first focal length may be focal length may be less than orequal to 1 mm, 2 mm, 4 mm, 6 mm, 5 mm, 6 mm, 8 mm, 10 mm, 12 mm, 14 mm,16 mm, 18 mm, 20 mm, 22 mm, 24 mm, 26 mm, 28 mm, 30 mm, 35 mm, 40 mm, 45mm, 50 mm, 55 mm, 60 mm, 65 mm, 70 mm, 75 mm, 80 mm, 85 mm, 90 mm, 95mm, 100 mm, 105 mm, 110 mm, 120 mm, 130 mm, 140 mm, 150 mm, 160 mm, 170mm, 180 mm, 190 mm, 200 mm, 220 mm, 240 mm, 260 mm, 280 mm, 300 mm, 320mm, 340 mm, 360 mm, 380 mm, 400 mm, 450 mm, 500 mm, 550 mm, 600 mm, 650mm, 700 mm, 750 mm, 800 mm, 850 mm, 900 mm, 950 mm, 1000 mm, 1150 mm, or1200 mm. In some embodiments, the second optical module comprises awide-angled lens module or a telescope lens module, substantially asdescribed herein.

The optical axis of the first lens module and an optical axis of thesecond lens module may coincide (e.g., intersect). For example, theoptical axis of the first lens module and an optical axis of the secondlens module may coincide with respect to an angular bisector of areflection angle and a refraction angle (e.g., of the optical element).In some embodiments, the optical axes of the first lens module and thesecond lens module coincide exactly at a point on the optical element.For example, the optical axes of the first lens module and the secondlens module may intersect on a surface of the optical element. In someembodiments, the optical axis of the first lens module and an opticalaxis of the second lens module are perpendicular.

In step 808, a first image (e.g., image data) is captured from the firstlight beam focused onto the first sensor. The first sensor may aid incapturing the first image, as previously described herein (e.g., byconverting optical information into digital information). The firstsensor may be a CMOS sensor, CCD sensor, NMOS sensor, BSI-CMOS sensor aspreviously described herein. The first sensor may have certaincharacteristics associated with it. For example, the first sensor mayhave a predetermined size, pixel size, number of pixels, etc aspreviously described herein. The first image may have a first field ofview. In some instances, the first field of view may be less than orequal to 180°, 170°, 169°, 165°, 160°, 155°, 150°, 145°, 140°, 135°,130°, 125°, 120°, 115°, 110°, 105°, 100°, 95°, 90°, 85°, 80°, 75°, 70°,65°, 60°, 55°, 50°, 45°, 40°, 35°, 30°, 25°, 20°, or 150°.

In step 810, a second image (e.g., image data) is captured from thesecond light beam focused onto the second sensor. The second sensor mayaid in capturing the second image, as previously described herein (e.g.,by converting optical information into digital information). The secondsensor may be a CMOS sensor, CCD sensor, NMOS sensor, BSI-CMOS sensor aspreviously described herein. In some instances, both the first sensorand the second sensor may be a CMOS sensor. The second sensor may havecertain characteristics associated with it. For example, the secondsensor may have a predetermined size, pixel size, number of pixels, etcas previously described herein. The second sensor may have differentcharacteristics from the first sensor. For example, the first sensor andthe second sensor may have different sizes (e.g., physical size),different number of pixels, and/or the size of each pixel on the firstsensor and the second sensor may be different. In some instances, thefirst sensor is larger in size than the second sensor. In someembodiments, each individual pixel on the first sensor is equal to orlarger than each individual pixel on the second sensor. The second imagemay have a second field of view. In some instances, the second field ofview may be less than or equal to 180°, 170°, 169°, 165°, 160°, 155°,150°, 145°, 140°, 135°, 130°, 125°, 120°, 115°, 110°, 105°, 100°, 95°,90°, 85°, 80°, 75°, 70°, 65°, 60°, 55°, 50°, 45°, 40°, 35°, 30°, 25°,20°, or 15°. The second field of view may be different from the firstfield of view. For example, the second field of view may be about 25%,50%, 75%, 100%, 125%, 150%, 200%, 300%, 400%, 500%, or 1000% of thefirst field of view. In some instances, the second field of view may beof a FOV that is narrower than the first field of view. There may be noparallax between the first image and the second image. For example,there may be no displacement or difference in the apparent position ofobjects within the first image and the second image.

Method 800 may further comprise combining, with aid of one or moreprocessors, the first image and the second image. Combining the imagemay comprise scaling the first image or the second image. In someinstances, the first image is scaled by

$\frac{{the}\mspace{14mu} {desire}\mspace{14mu} {pixel}{\mspace{11mu} \;}{size}}{{the}\mspace{11mu} {second}{\mspace{11mu} \;}{pixel}\mspace{14mu} {size}}.$

In some instances, the second image is scaled by

$\frac{{the}\mspace{14mu} {second}\mspace{14mu} {pixel}{\mspace{11mu} \;}{size}}{{the}\mspace{11mu} {first}{\mspace{11mu} \;}{pixel}\mspace{14mu} {size}}.$

In some instances, only the first image or the second image is scaled,but not both. For example, only the image generated (e.g., captured)using a larger sensor between the two sensors (e.g., the first sensor)is scaled. Scaling the first image and/or the second image may utilize acubic interpolation algorithm or a bilinear interpolation algorithm. Thefirst scaled image and the second image may have the same relativemagnification. For example, the relative size of objects within thefirst scaled image and the second image may be the same. Combining thefirst image and the second image may comprise fusing the scaled firstimage and the second image. The fused image may be seamlesslyintegrated. For example, the scaled first image and the second image maybe fused in areas in which a field of view of the first scaled image andthe second scaled image overlaps. Portions of the scaled first image maybe utilized for areas in which a field of view of the first scaled imageand the second scaled image do not overlap if necessary, as describedfurther below. For example, the scaled first image and the second imagemay be aligned (e.g., at the center). The scaled first image mayencompass the second image. The aligned scaled first image and thesecond image may comprise an overlapping region and a non-overlappingregion. For example, the entirety of the second image and an innerportion of the scaled first image may comprise the overlapping region.An outer portion of the scaled first image may comprise thenon-overlapping region. The scaled first image and the second image maybe fused using a Laplacian pyramid algorithm or a weighted averagealgorithm. In some embodiments, fusing the scaled first image and thesecond image may comprise pixel fusion. A fused image may have a betterquality image in the overlapping region compared to the scaled firstimage or the second image. A better quality image as used herein mayrefer to an image having a higher resolution or more information thananother image.

In some embodiments, a desired field of view may be received at the oneor more processors. The desired field of view may correspond to adesired magnification, a desired zoom, desired focal length, and thelike. For example, the desired field of view may be input by a user aspreviously described herein (e.g., by zooming image of an environment inreal time). The desired field of view may be equal to or narrower thanat least one of the first field of view or the second field of view. Thedesired field of view may be limited to only allow inputs that are equalto or narrower than at least one of the first field of view or thesecond field of view. If a field of view wider than both the first fieldof view and the second field of view is selected, an error message maybe output (e.g., on a display) to inform the user.

A determination may be made whether the desired field of view isnarrower than the narrower first field of view and the second field ofview. If the desired field of view is narrower than the first field ofview and the second field of view, only the image generated by thelarger sensor (e.g., the first sensor) may be utilized in generating adesired image (e.g., image having the desired field of view). Forexample, digital zoom may be performed on the image generated by thelarger sensor (e.g., the first sensor) and be cropped to simulate theimage having the desired field of view. In some embodiments, if thedesired field of view is narrower than the field of view of an imagegenerated using the smaller sensor (e.g., the second sensor), the scaledfirst image and the second image (e.g., non-scaled) may be fused togenerate an image as previously described herein. The fused image may bescaled to a desired size and/or cropped as appropriate to generate thedesired FOV. The combined image may be comprised wholly of the fusedparts (e.g., pixel fused parts). If the desired field of view is widerthan the field of view of an image generated using the smaller sensor(e.g., but narrower than the field of view of an image generated usingthe larger sensor), the scaled first image and the second image may befused to generate a combined image as previously described herein. Thefused image may be scaled to a desired size and/or cropped asappropriate to generate the desired FOV. The combined image may becomprised of an inner FOV comprised of the fused parts (e.g., pixelfused parts) and an outer FOV comprised of the scaled first image (e.g.,image with the larger FOV). The combined image may have a field of viewcorresponding to the desired field of view.

FIG. 9 illustrates an image having a desired FOV, in accordance withembodiments. A desired field of view may be received at one or moreprocessors. In some instances, a first image may be acquired using afirst lens module and a first sensor and a second image may be acquiredusing a second lens module and a second sensor. In some instances, thefirst lens module and the second lens module may be the same type and/orhave the same characteristics. In some embodiments, the first sensor andthe second sensor may have different characteristics, such as thedifferent sensor sizes, different number of pixels, and/or havedifferent same pixel sizes. In some embodiments, the first sensor mayhave a larger size compared to the second sensor and each individualpixel size on the first sensor may be equal to or greater than eachindividual pixel size on the second sensor. In such a case, the firstimage may be scaled by

$\frac{{the}\mspace{14mu} {first}\mspace{14mu} {pixel}{\mspace{11mu} \;}{size}}{{the}\mspace{11mu} {second}{\mspace{11mu} \;}{pixel}\mspace{14mu} {size}}$

as previously described herein. For example, image 906 may represent ascaled first image and image 902 may represent a second image. Whenaligned, the scaled first image and the second image may have a commoncenter 905. When aligned, the scaled first image and the second imagemay have an overlapping portion defined by the field of view of thesecond image.

The desired field of view may be narrower than a field of view of thesecond image (e.g., image with the narrower FOV). For example, image 908may represent an image having a desired field of view (e.g., an imagehaving a desired field of view, image having a desired magnification,etc). Image 908 may be generated by fusing image 902 and image 906. Thefused image may be seamlessly integrated. The fused image may be croppedto generate the image 908 having a desired field of view and/or scaledto a desired size (e.g., desired magnification). The image 908 having adesired field of view may comprise only of fused parts (e.g., pixelfused parts).

The desired field of view may be wider than a field of view of thesecond image (e.g., image with the narrower FOV) but narrower than afield of view of the first image (e.g., image with the wider FOV). Forexample, image 904 may represent an image having a desired field ofview. Image 904 may be generated by fusing image 902 and image 906. Thefused image may be cropped to generate the image 904 having a desiredfield of view and/or scaled to a desired size (e.g., desiredmagnification). The image 904 having a desired focal length may comprisean inner FOV (e.g., inner portion) 910 comprised of the fused parts(e.g., pixel fused parts) and an outer FOV (e.g., outer portion) 912comprised of the scaled first image (e.g., image with the larger FOV).

FIG. 10 illustrates an image 1000 comprising an inner FOV comprised offused parts 1002 (e.g., pixel fused parts) and an outer FOV comprised ofnon-fused parts 1004, in accordance with embodiments. For example, image1000 may illustrate an image having a desired focal length between afocal length of a telescope lens module and a wide-angled lens module asdescribed in relation to FIG. 7. Alternatively, image 1000 mayillustrate an image having a desired FOV between a first FOV (e.g., FOVof a first scaled image) and a second FOV (e.g., FOV of a second image)as described in relation to FIG. 9.

An imaging system as used herein may be installed on a stationery objector a movable object. A movable object may be capable of self-propelledmovement (e.g., a vehicle), while a stationary object may not be capableof self-propelled movement. In some embodiments, the movable object maybe an unmanned aerial vehicle (UAV). The UAV may have one or morepropulsion units that may permit the UAV to move about in the air. TheUAV may be a rotorcraft. In some instances, the UAV may be a multi-rotorcraft that may include a plurality of rotors. The plurality or rotorsmay be capable of rotating to generate lift for the UAV, enabling theUAV to move about freely through the air (e.g., with up to three degreesof freedom in translation and/or up to three degrees of freedom inrotation). In some embodiments, the imaging system of present disclosuremay be onboard the UAV. Additional examples of movable objects suitablefor use with the embodiments of the present disclosure are provided infurther detail below.

FIG. 11 illustrates an unmanned aerial vehicle (UAV) 1100 carrying animaging system having two or more optical modules, in accordance withembodiments. Any description herein of the imaging system supported bythe UAV may apply to any other type of imaging system, or an imagingsystem supported by any movable object. The UAV may have a body 1120. Insome instances, the body may be a central body which may have one ormore branching members, or “arms.” The arms may extend outward from thecentral body in a radial manner and be joined via the central body. Thenumber of arms may match the number of propulsion units 1125, or rotors,of the UAV. The body may comprise a housing. The housing may enclose oneor more components of the UAV within the housing. In some instances, oneor more electrical components of the UAV may be provided within thehousing. For example, a flight controller of the UAV may be providedwithin the housing. The flight controller may control operation of oneor more propulsion units of the UAV.

An imaging system 1130 may be supported by the UAV. The imaging systemmay be directly coupled to the UAV or may be coupled to the UAV via acarrier. The imaging system may comprise a plurality of optical modules.For example, one, two, three, four, five, six, or more optical modulesmay be provided. Any description of a first optical module and a secondoptical module may apply to any number of optical modules. The imagingsystem 1130 may be enclosed within a housing, as previously describedherein (e.g., light impenetrable housing). In some instances, anaperture 1180 for receiving light may be provided. One, two, three,four, five or more apertures may be provided. Any light received by theimaging system may pass through aperture 1180 before being received byother components of the imaging system. The aperture 1180 may be movablerelative to the UAV, relative to the housing, and/or relative to othercomponents of the imaging system. For example, the aperture may betranslatable relative to the housing or the UAV. For example, theaperture may be rotatable relative to the housing or the UAV.

The first optical module may be housed within a first location 1140 andsecond optical module may be housed within a second location 1160. Thefirst optical module and the second optical module may be rigidlycoupled to the UAV. Alternatively, the first optical module and secondoptical module may be permitted to move relative to the UAV 1120 withrespect to up to six degrees of freedom. The first optical module andsecond optical module may be directly mounted onto the UAV, or coupledto a support structure mounted onto the UAV. In some embodiments, thefirst optical module and second optical module may be an element of apayload of the UAV. In some embodiments, the first optical module andsecond optical module may be installed on a carrier of the UAV. In someembodiments, the carrier may be a gimbal. In some instances, the firstoptical module and/or second optical module may be movable relative toone or more propulsion units of the UAV via the carrier. For instance,the carrier may permit rotation of the first optical module and/or thesecond optical module about at least one axis. Optionally, the carrierpermits rotation of the first optical module and/or the second opticalmodule about at least two or three axes. The first optical module and/orsecond optical module may be movable relative to a central body of theUAV. The first optical module and/or the second optical module maytranslate relative to the central body of the UAV along one, two, threeor more axes.

In some embodiments, the first optical module and second optical modulemay have the same size. For instance, the first optical module and thesecond optical module may have the same volume. The first optical moduleand the second optical module may have one, two, or three of the samedimensions (e.g., length, width, height). The first optical module andthe second optical module may have the same weight. Alternatively, thefirst optical module and second optical module may have different size.For instance, the first optical module and the second optical module mayhave different volumes. The first optical module may have a volume thatis 25%, 50%, 75%, 100%, 125%, 150%, 200%, 300%, 400%, 500%, or 1000% ofthe second optical module. The first optical module and the secondoptical module may have one, two, or three different dimensions (e.g.,length, width, height). The first optical module and the second opticalmodule may have different weights. The first optical module may have aweight that is 25%, 50%, 75%, 100%, 125%, 150%, 200%, 300%, 400%, 500%,or 1000% of the second optical module.

Each module of an imaging system may have the same optical set-up.Alternatively, each module of the imaging system may have differentoptical set-ups, or at least two optical modules of an imaging systemmay have different optical set-ups. In some embodiments, a first opticalmodule may have a stationary lens while a second optical module may havea movable lens. In other embodiments, the first and second opticalmodules may have movable lenses that may have different dimensions orshapes, or that may move by different amounts. Optical modules of animaging system may remain stationary relative to one another. Opticalmodules may remain stationary to one another while the imaging systemmoves relative to an environment. Alternatively, the optical modules maybe movable relative to one another.

Each optical module of the imaging system may capture images of anenvironment with a field of view. Each optical module of the imagingsystem may capture images as previously described herein (e.g., withoutan optical parallax, along the same line of sight, with a same center,with differing fields of views, etc). A field of view of captured by theimaging system may be affected by a variety of factors. In someinstances, a direction and/or orientation of the UAV 1100 may affect aFOV of images to be captured by the imaging system. In some instances,configuration a carrier (e.g., gimbal) may affect a FOV. In someinstances, configuration of the imaging system components may affect aFOV of images to be captured. For example, movement of aperture 1180 mayaffect a change in FOV of images to be captured. For example, change ina desired FOV may affect a change in FOV of images to be captured.

In some instances, a FOV of images to be captured may be controlled viaan input device such as a remote controller. In some instances, theremote controller may control the UAV (e.g., speed, orientation,movement, position, etc of the UAV), the carrier (e.g., orientation,position, etc of the gimbal), and/or the imaging system (e.g., focallength of the lens modules, desired focal length of images to becaptured, aperture orientation, exposure, etc). In some instances, theremote controller may comprise a display for displaying a FOV of theenvironment to be captured by the imaging system. For example, thedisplay may show an image of an environment that is to be captured bythe imaging system in real time. The image shown in the display maychange in response to a change in the UAV, the carrier, and or theimaging system. In some instances, the display may show a combined(e.g., fused image) image. The combined image may be a scaled and/orfused image of an image captured by the first optical module and/or animage captured by the second optical module. The combined image may beas described in FIG. 10 (e.g., having an inner FOV (e.g., inner portion)comprised of fused parts (e.g., pixel fused parts) and an outer FOV(e.g., outer portion) comprised of a scaled image. In some instances, auser may select a FOV to be shown in the display, as described furtherbelow.

FIG. 12 illustrates a method 1200 for generating images, in accordancewith embodiments. An imaging device for capturing and/or generatingimages may be coupled to a UAV. The imaging device may comprise anoptical element, a first lens module, a second lens module, a firstsensor and a second sensor, and/or one or more processors, as previouslydescribed herein.

In step 1202, flight of an unmanned aerial vehicle may be effected. Insome instances, the flight of the UAV may be effected manually,semi-automatically, or automatically. For example, the UAV may beconfigured to fly and follow a preconfigured path. In some instances,the flight of the UAV may be manually controlled by a user (e.g., usinga remote control). The imaging device may be configured to captureimages of an environment (e.g., in real time) while flight of the UAV iseffected. In some instances, a controller may be provided. Thecontroller may control aspects of the UAV, a carrier (e.g., gimbal)coupled to the UAV, and/or the imaging device coupled to the UAV aspreviously described herein. The controller may affect a field of viewto be captured by the imaging device in many different ways. Forexample, controlling a position and/or orientation of the UAV may affecta FOV of the images to be captured. For example, controlling a positionand/or orientation of the carrier may affect a FOV of images to becaptured. For example, controlling parameters of the imaging device mayaffect a FOV of images to be captured. In some instances, a display maybe provided (e.g., to a user) who may control operation of the imagingdevice (e.g., relative direction to the UAV, optical zoom, etc) or whatis shown in the display (e.g., digital zoom, inputting a desired focallength, etc). Input of the user may be received in real time.

Step 1204 of receiving light at the imaging device, step 1206 ofseparating the light into a first light beam and a second light beam,step 1208 of focusing the first light beam with aid of the first lensmodule, step 1210 of focusing the second light beam with aid of thesecond lens module, step 1212 of capturing a first image from the firstlight beam focused by the first lens module onto the first sensor, andstep 1214 of capturing a second image from the second light beam focusedby the second lens module onto the sensor may be as previously describedherein (e.g., as described with respect to FIGS. 2, 4, 8). Method 1200may further comprise combining, with aid of one or more processors, thefirst image and the second image as previously described herein. In someinstances, a combined image may be shown on the display, as previouslydescribed herein. The combined image may be displayed in real time.

In some instances, a user may select a FOV to be shown in the display.For example, the user may select a wider or narrower FOV to be shown inthe display. For example, a user may zoom in or out of the image shownin the display via input on the controller (e.g., physical buttons orvia touch screen input). In some instances, a user may adjust a FOVshown in the display via input on the controller. For example, the usermay adjust the FOV so that the FOV is translated (e.g., up, down, left,right) and/or rotated via physical buttons on the controller or viainput on a touch screen. In some instances, a user may select (e.g., viainput on a touch screen) a point, portion, or object shown within thedisplay. For example, a user may tap the point, portion, or object shownwithin the display with a finger. An image shown in the display may bere-centered such that the point, portion, or object selected by the usermay be at a center of the display after such selection. Afterre-centering, the image shown in the display may (again) comprise aninner FOV comprised of fused parts and an outer FOV comprised of ascaled image. For example, the selected point, portion, or object may bedisplayed with a high quality (e.g., high resolution, pixel fusedparts).

The systems and methods described hereinabove may permit a user to viewa display of arbitrary field of view. In some instances, an image havinga wide field of view may be shown on the display. The image may havediffering qualities (e.g., resolution) and/or show differing details ator near a center of the image compared to at or near an edge of theimage. For example, if a desired field of view (e.g., field of viewselected by a user) is higher than a field of view of at least oneoptical module is selected, an inner portion of the image may havegreater resolution (e.g., detail) than an outer portion of the image. Insome instances, a user may view a wide field of view image while stillhaving a highly detailed central portion.

Being able to viewing an image with a wide field of view (e.g., on animage) may enable a user to have a greater awareness of an environmentwhich may be useful for general photography and/or UAV operations.However, while showing a wide field of view image on the display, theimaging systems described herein may concurrently acquire and displaydetailed images having a narrower field of view (e.g., zoomed image,magnified images, etc) on a central portion of the image. The inner(e.g., central) portion and the outer (e.g., peripheral) portion of theimage may be seamless integrated (e.g., by image fusion). In someinstances, having a detailed central portion may be useful for generalphotography and/or UAV operations. In some instances, a detailed centralportion may contain useful information that may not be present in animage having a wide field of view (e.g., a non-fused image). In someinstances, the useful information may be identifiable by a user and/orone or more processors. For example, a user and/or one or moreprocessors may be able to identify points of interest or objects thatwould not be present in an image having a wide field of view (e.g., anon-fused image). In some instances, a user may select (e.g., tap) aportion of the inner portion of the image to zoom in on the image. Insome instances, a user may swipe a screen of the display to change acenter of a field of view of the image shown in the display. In someinstances, a user may tap a portion of the outer portion of the image tore-center on a tapped outer portion of the image.

A change in FOV in response to the user selection may be affected by achange in position or orientation of the UAV, a change in position ororientation of a carrier, and/or change in configuration of the imagingsystem. In some instances, a change in FOV in response to the userselection may be affected according to a predetermined hierarchy oraccording to a set criteria. For example, in response to a selection ofa point shown in the display, a configuration of the imaging system mayfirst be affected (e.g., orientation of the aperture) before affecting aconfiguration of the carrier and/or UAV.

In the embodiments discussed hereinabove, images may be captured,combined and displayed by the imaging system of the present invention.However, the imaging system may also be used to capture and displayvideos. In some embodiments, both or one of a first video captured by afirst optical module having a first FOV or first focal length, and asecond video captured by a second optical module having a second FOV orsecond focal length, may be displayed, as discussed hereinabove.Alternatively, one of the first and second optical modules may capturean image, and the other one of the first and second optical modules maycapture a video. Both or only one of the captured image and video may bedisplayed, in a manner as discussed hereinabove. In some embodiments, acombined video generated from the first video and the second video maybe displayed.

The number of the optical modules may not necessarily be two. In someembodiments, the imaging system of present invention may comprise threeor more optical modules which are configured to capture images and/orvideo from the same direction. In this case, arbitrary number of aplurality of images and/or videos captured by a plurality of opticalmodules may be selectively displayed, in a manner as discussedhereinabove.

The imaging system having multiple optical modules of present inventionmay be particularly suitable for aerial vehicles such as UAVs or smallmovable objects, such as cell phones.

In some instances, the multiple optical modules may be low weight;therefore, one or more additional optical modules onboard the UAV maynot add great load to the UAV or adversely affect the flexibility andlifetime of the UAV. In some instances, the dimension of the multipleoptical modules may be small if compared with the traditional opticalmodule such as a zoom type optical module having a set of opticallenses.

The UAV carrying an imaging system having multiple optical modules ofpresent invention may facilitate a user in image and/or video viewing.In some instances, the user may view the image and/or video of a scenecaptured by the UAV through a first optical module having a moderatefocal length or focal length range. If the user has particular intereston a portion of the scene as displayed, the user can view an enlargedview of the interested point or portion of scene through a secondoptical module having a larger focal length or focal length range or acombined image generated from image data captured by both the firstoptical module and the second optical module.

The UAV carrying an imaging system having multiple optical modules ofpresent invention may provide more interactive operation with the user.In some instances, the user may view the image and/or video captured bythe UAV flying around, and select a point or a portion of interest onthe displayed image and/or video. The selection of the point or portionof interest may be implemented by operating buttons provided on thedisplay device or on the UAV. Alternatively, the selection of the pointof interest may be implemented by touching soft buttons displayed on ascreen of the remote terminal. Optionally, the selection of the portionof interest may be implemented by touching a screen of the remoteterminal by multiple fingers of the user. The user may select a desiredzoom, FOV and/or focal length of the point or portion of interest to befurther displayed on the initial image. Optionally, the user may selecta position, a size, a shape and/or a pattern of the point or portion ofinterest to be further displayed on the initial image.

The systems, devices, and methods described herein can be applied to awide variety of objects, including movable objects and stationaryobjects. As previously mentioned, any description herein of an aerialvehicle, such as a UAV, may apply to and be used for any movable object.Any description herein of an aerial vehicle may apply specifically toUAVs. A movable object of the present invention can be configured tomove within any suitable environment, such as in air (e.g., a fixed-wingaircraft, a rotary-wing aircraft, or an aircraft having neither fixedwings nor rotary wings), in water (e.g., a ship or a submarine), onground (e.g., a motor vehicle, such as a car, truck, bus, van,motorcycle, bicycle; a movable structure or frame such as a stick,fishing pole; or a train), under the ground (e.g., a subway), in space(e.g., a spaceplane, a satellite, or a probe), or any combination ofthese environments. The movable object can be a vehicle, such as avehicle described elsewhere herein. In some embodiments, the movableobject can be carried by a living subject, or take off from a livingsubject, such as a human or an animal. Suitable animals can includeavines, canines, felines, equines, bovines, ovines, porcines, delphines,rodents, or insects.

The movable object may be capable of moving freely within theenvironment with respect to six degrees of freedom (e.g., three degreesof freedom in translation and three degrees of freedom in rotation).Alternatively, the movement of the movable object can be constrainedwith respect to one or more degrees of freedom, such as by apredetermined path, track, or orientation. The movement can be actuatedby any suitable actuation mechanism, such as an engine or a motor. Theactuation mechanism of the movable object can be powered by any suitableenergy source, such as electrical energy, magnetic energy, solar energy,wind energy, gravitational energy, chemical energy, nuclear energy, orany suitable combination thereof. The movable object may beself-propelled via a propulsion system, as described elsewhere herein.The propulsion system may optionally run on an energy source, such aselectrical energy, magnetic energy, solar energy, wind energy,gravitational energy, chemical energy, nuclear energy, or any suitablecombination thereof. Alternatively, the movable object may be carried bya living being.

In some instances, the movable object can be an aerial vehicle. Forexample, aerial vehicles may be fixed-wing aircraft (e.g., airplane,gliders), rotary-wing aircraft (e.g., helicopters, rotorcraft), aircrafthaving both fixed wings and rotary wings, or aircraft having neither(e.g., blimps, hot air balloons). An aerial vehicle can beself-propelled, such as self-propelled through the air. A self-propelledaerial vehicle can utilize a propulsion system, such as a propulsionsystem including one or more engines, motors, wheels, axles, magnets,rotors, propellers, blades, nozzles, or any suitable combinationthereof. In some instances, the propulsion system can be used to enablethe movable object to take off from a surface, land on a surface,maintain its current position and/or orientation (e.g., hover), changeorientation, and/or change position.

The movable object can be controlled remotely by a user or controlledlocally by an occupant within or on the movable object. The movableobject may be controlled remotely via an occupant within a separatevehicle. In some embodiments, the movable object is an unmanned movableobject, such as a UAV. An unmanned movable object, such as a UAV, maynot have an occupant onboard the movable object. The movable object canbe controlled by a human or an autonomous control system (e.g., acomputer control system), or any suitable combination thereof. Themovable object can be an autonomous or semi-autonomous robot, such as arobot configured with an artificial intelligence.

The movable object can have any suitable size and/or dimensions. In someembodiments, the movable object may be of a size and/or dimensions tohave a human occupant within or on the vehicle. Alternatively, themovable object may be of size and/or dimensions smaller than thatcapable of having a human occupant within or on the vehicle. The movableobject may be of a size and/or dimensions suitable for being lifted orcarried by a human. Alternatively, the movable object may be larger thana size and/or dimensions suitable for being lifted or carried by ahuman. In some instances, the movable object may have a maximumdimension (e.g., length, width, height, diameter, diagonal) of less thanor equal to about: 2 cm, 5 cm, 10 cm, 50 cm, 1 m, 2 m, 5 m, or 10 m. Themaximum dimension may be greater than or equal to about: 2 cm, 5 cm, 10cm, 50 cm, 1 m, 2 m, 5 m, or 10 m. For example, the distance betweenshafts of opposite rotors of the movable object may be less than orequal to about: 2 cm, 5 cm, 10 cm, 50 cm, 1 m, 2 m, 5 m, or 10 m.Alternatively, the distance between shafts of opposite rotors may begreater than or equal to about: 2 cm, 5 cm, 10 cm, 50 cm, 1 m, 2 m, 5 m,or 10 m.

In some embodiments, the movable object may have a volume of less than100 cm×100 cm×100 cm, less than 50 cm×50 cm×30 cm, or less than 5 cm×5cm×3 cm. The total volume of the movable object may be less than orequal to about: 1 cm³, 2 cm³, 5 cm³, 10 cm³, 20 cm³, 30 cm³, 40 cm³, 50cm³, 60 cm³, 70 cm³, 80 cm³, 90 cm³, 100 cm³, 150 cm³, 200 cm³, 300 cm³,500 cm³, 750 cm³, 1000 cm³, 5000 cm³, 10,000 cm³, 100,000 cm³, 1 m³, or10 m³. Conversely, the total volume of the movable object may be greaterthan or equal to about: 1 cm³, 2 cm³, 5 cm³, 10 cm³, 20 cm³, 30 cm³, 40cm³, 50 cm³, 60 cm³, 70 cm³, 80 cm³, 90 cm³, 100 cm³, 150 cm³, 200 cm³,300 cm³, 500 cm³, 750 cm³, 1000 cm³, 5000 cm³, 10,000 cm³, 100,000 cm³,1 m³, or 10 m³.

In some embodiments, the movable object may have a footprint (which mayrefer to the lateral cross-sectional area encompassed by the movableobject) less than or equal to about: 32,000 cm², 20,000 cm², 10,000 cm²,1,000 cm², 500 cm², 100 cm², 50 cm², 10 cm², or 5 cm². Conversely, thefootprint may be greater than or equal to about: 32,000 cm², 20,000 cm²,10,000 cm², 1,000 cm², 500 cm², 100 cm², 50 cm², 10 cm², or 5 cm².

In some instances, the movable object may weigh no more than 1000 kg.The weight of the movable object may be less than or equal to about:1000 kg, 750 kg, 500 kg, 200 kg, 150 kg, 100 kg, 80 kg, 70 kg, 60 kg, 50kg, 45 kg, 40 kg, 35 kg, 30 kg, 25 kg, 20 kg, 15 kg, 12 kg, 10 kg, 9 kg,8 kg, 7 kg, 6 kg, 5 kg, 4 kg, 3 kg, 2 kg, 1 kg, 0.5 kg, 0.1 kg, 0.05 kg,or 0.01 kg. Conversely, the weight may be greater than or equal toabout: 1000 kg, 750 kg, 500 kg, 200 kg, 150 kg, 100 kg, 80 kg, 70 kg, 60kg, 50 kg, 45 kg, 40 kg, 35 kg, 30 kg, 25 kg, 20 kg, 15 kg, 12 kg, 10kg, 9 kg, 8 kg, 7 kg, 6 kg, 5 kg, 4 kg, 3 kg, 2 kg, 1 kg, 0.5 kg, 0.1kg, 0.05 kg, or 0.01 kg.

In some embodiments, a movable object may be small relative to a loadcarried by the movable object. The load may include a payload and/or acarrier, as described in further detail elsewhere herein. In someexamples, a ratio of a movable object weight to a load weight may begreater than, less than, or equal to about 1:1. In some instances, aratio of a movable object weight to a load weight may be greater than,less than, or equal to about 1:1. Optionally, a ratio of a carrierweight to a load weight may be greater than, less than, or equal toabout 1:1. When desired, the ratio of an movable object weight to a loadweight may be less than or equal to: 1:2, 1:3, 1:4, 1:5, 1:10, or evenless. Conversely, the ratio of a movable object weight to a load weightcan also be greater than or equal to: 2:1, 3:1, 4:1, 5:1, 10:1, or evengreater.

In some embodiments, the movable object may have low energy consumption.For example, the movable object may use less than about: 5 W/h, 4 W/h, 3W/h, 2 W/h, 1 W/h, or less. In some instances, a carrier of the movableobject may have low energy consumption. For example, the carrier may useless than about: 5 W/h, 4 W/h, 3 W/h, 2 W/h, 1 W/h, or less. Optionally,a payload of the movable object may have low energy consumption, such asless than about: 5 W/h, 4 W/h, 3 W/h, 2 W/h, 1 W/h, or less.

FIG. 13 illustrates an unmanned aerial vehicle (UAV) 1300, in accordancewith embodiments of the present invention. The UAV may be an example ofa movable object as described herein, to which the method and apparatusof discharging a battery assembly may be applied. The UAV 1300 caninclude a propulsion system having four rotors 1302, 1304, 1306, and1308. Any number of rotors may be provided (e.g., one, two, three, four,five, six, or more). The rotors, rotor assemblies, or other propulsionsystems of the unmanned aerial vehicle may enable the unmanned aerialvehicle to hover/maintain position, change orientation, and/or changelocation. The distance between shafts of opposite rotors can be anysuitable length 1310. For example, the length 1310 can be less than orequal to 2 m, or less than equal to 5 m. In some embodiments, the length1310 can be within a range from 40 cm to 1 m, from 10 cm to 2 m, or from5 cm to 5 m. Any description herein of a UAV may apply to a movableobject, such as a movable object of a different type, and vice versa.The UAV may use an assisted takeoff system or method as describedherein.

In some embodiments, the movable object can be configured to carry aload. The load can include one or more of passengers, cargo, equipment,instruments, and the like. The load can be provided within a housing.The housing may be separate from a housing of the movable object, or bepart of a housing for a movable object. Alternatively, the load can beprovided with a housing while the movable object does not have ahousing. Alternatively, portions of the load or the entire load can beprovided without a housing. The load can be rigidly fixed relative tothe movable object. Optionally, the load can be movable relative to themovable object (e.g., translatable or rotatable relative to the movableobject). The load can include a payload and/or a carrier, as describedelsewhere herein.

In some embodiments, the movement of the movable object, carrier, andpayload relative to a fixed reference frame (e.g., the surroundingenvironment) and/or to each other, can be controlled by a terminal. Theterminal can be a remote control device at a location distant from themovable object, carrier, and/or payload. The terminal can be disposed onor affixed to a support platform. Alternatively, the terminal can be ahandheld or wearable device. For example, the terminal can include asmartphone, tablet, laptop, computer, glasses, gloves, helmet,microphone, or suitable combinations thereof. The terminal can include auser interface, such as a keyboard, mouse, joystick, touchscreen, ordisplay. Any suitable user input can be used to interact with theterminal, such as manually entered commands, voice control, gesturecontrol, or position control (e.g., via a movement, location or tilt ofthe terminal).

The terminal can be used to control any suitable state of the movableobject, carrier, and/or payload. For example, the terminal can be usedto control the position and/or orientation of the movable object,carrier, and/or payload relative to a fixed reference from and/or toeach other. In some embodiments, the terminal can be used to controlindividual elements of the movable object, carrier, and/or payload, suchas the actuation assembly of the carrier, a sensor of the payload, or anemitter of the payload. The terminal can include a wirelesscommunication device adapted to communicate with one or more of themovable object, carrier, or payload.

The terminal can include a suitable display unit for viewing informationof the movable object, carrier, and/or payload. For example, theterminal can be configured to display information of the movable object,carrier, and/or payload with respect to position, translationalvelocity, translational acceleration, orientation, angular velocity,angular acceleration, or any suitable combinations thereof. In someembodiments, the terminal can display information provided by thepayload, such as data provided by a functional payload (e.g., imagesrecorded by a camera or other image capturing device).

Optionally, the same terminal may both control the movable object,carrier, and/or payload, or a state of the movable object, carrierand/or payload, as well as receive and/or display information from themovable object, carrier and/or payload. For example, a terminal maycontrol the positioning of the payload relative to an environment, whiledisplaying image data captured by the payload, or information about theposition of the payload. Alternatively, different terminals may be usedfor different functions. For example, a first terminal may controlmovement or a state of the movable object, carrier, and/or payload whilea second terminal may receive and/or display information from themovable object, carrier, and/or payload. For example, a first terminalmay be used to control the positioning of the payload relative to anenvironment while a second terminal displays image data captured by thepayload. Various communication modes may be utilized between a movableobject and an integrated terminal that both controls the movable objectand receives data, or between the movable object and multiple terminalsthat both control the movable object and receives data. For example, atleast two different communication modes may be formed between themovable object and the terminal that both controls the movable objectand receives data from the movable object.

FIG. 14 illustrates a movable object 1400 including a carrier 1402 and apayload 1404, in accordance with embodiments of the present invention.Although the movable object 1400 is depicted as an aircraft, thisdepiction is not intended to be limiting, and any suitable type ofmovable object can be used, as previously described herein. One of skillin the art would appreciate that any of the embodiments described hereinin the context of aircraft systems can be applied to any suitablemovable object (e.g., an UAV). In some instances, the payload 1404 maybe provided on the movable object 1400 without requiring the carrier1402. The movable object 1400 may include propulsion mechanisms 1406, asensing system 1408, and a communication system 1410.

The propulsion mechanisms 1406 can include one or more of rotors,propellers, blades, engines, motors, wheels, axles, magnets, or nozzles,as previously described. The movable object may have one or more, two ormore, three or more, or four or more propulsion mechanisms. Thepropulsion mechanisms may all be of the same type. Alternatively, one ormore propulsion mechanisms can be different types of propulsionmechanisms. The propulsion mechanisms 1406 can be mounted on the movableobject 1400 using any suitable means, such as a support element (e.g., adrive shaft) as described elsewhere herein. The propulsion mechanisms1406 can be mounted on any suitable portion of the movable object 1400,such on the top, bottom, front, back, sides, or suitable combinationsthereof.

In some embodiments, the propulsion mechanisms 1406 can enable themovable object 1400 to take off vertically from a surface or landvertically on a surface without requiring any horizontal movement of themovable object 1400 (e.g., without traveling down a runway). Optionally,the propulsion mechanisms 1406 can be operable to permit the movableobject 1400 to hover in the air at a specified position and/ororientation. One or more of the propulsion mechanisms 1400 may becontrolled independently of the other propulsion mechanisms.Alternatively, the propulsion mechanisms 1400 can be configured to becontrolled simultaneously. For example, the movable object 1400 can havemultiple horizontally oriented rotors that can provide lift and/orthrust to the movable object. The multiple horizontally oriented rotorscan be actuated to provide vertical takeoff, vertical landing, andhovering capabilities to the movable object 1400. In some embodiments,one or more of the horizontally oriented rotors may spin in a clockwisedirection, while one or more of the horizontally rotors may spin in acounterclockwise direction. For example, the number of clockwise rotorsmay be equal to the number of counterclockwise rotors. The rotation rateof each of the horizontally oriented rotors can be varied independentlyin order to control the lift and/or thrust produced by each rotor, andthereby adjust the spatial disposition, velocity, and/or acceleration ofthe movable object 1400 (e.g., with respect to up to three degrees oftranslation and up to three degrees of rotation).

The sensing system 1408 can include one or more sensors that may sensethe spatial disposition, velocity, and/or acceleration of the movableobject 1400 (e.g., with respect to up to three degrees of translationand up to three degrees of rotation). The one or more sensors caninclude global positioning system (GPS) sensors, motion sensors,inertial sensors, proximity sensors, or image sensors. The sensing dataprovided by the sensing system 1408 can be used to control the spatialdisposition, velocity, and/or orientation of the movable object 1400(e.g., using a suitable processing unit and/or control module, asdescribed below). Alternatively, the sensing system 1408 can be used toprovide data regarding the environment surrounding the movable object,such as weather conditions, proximity to potential obstacles, locationof geographical features, location of manmade structures, and the like.

The communication system 1410 enables communication with terminal 1412having a communication system 1414 via wireless signals 1416. Thecommunication systems 1410, 1414 may include any number of transmitters,receivers, and/or transceivers suitable for wireless communication. Thecommunication may be one-way communication, such that data can betransmitted in only one direction. For example, one-way communicationmay involve only the movable object 1400 transmitting data to theterminal 1412, or vice-versa. The data may be transmitted from one ormore transmitters of the communication system 1410 to one or morereceivers of the communication system 1412, or vice-versa.Alternatively, the communication may be two-way communication, such thatdata can be transmitted in both directions between the movable object1400 and the terminal 1412. The two-way communication can involvetransmitting data from one or more transmitters of the communicationsystem 1410 to one or more receivers of the communication system 1414,and vice-versa.

In some embodiments, the terminal 1412 can provide control data to oneor more of the movable object 1400, carrier 1402, and payload 1404 andreceive information from one or more of the movable object 1400, carrier1402, and payload 1404 (e.g., position and/or motion information of themovable object, carrier or payload; data sensed by the payload such asimage data captured by a payload camera). In some instances, controldata from the terminal may include instructions for relative positions,movements, actuations, or controls of the movable object, carrier and/orpayload. For example, the control data may result in a modification ofthe location and/or orientation of the movable object (e.g., via controlof the propulsion mechanisms 1406), or a movement of the payload withrespect to the movable object (e.g., via control of the carrier 1402).The control data from the terminal may result in control of the payload,such as control of the operation of a camera or other image capturingdevice (e.g., taking still or moving pictures, zooming in or out,turning on or off, switching imaging modes, change image resolution,changing focus, changing depth of field, changing exposure time,changing viewing angle or field of view). In some instances, thecommunications from the movable object, carrier and/or payload mayinclude information from one or more sensors (e.g., of the sensingsystem 1408 or of the payload 1404). The communications may includesensed information from one or more different types of sensors (e.g.,GPS sensors, motion sensors, inertial sensor, proximity sensors, orimage sensors). Such information may pertain to the position (e.g.,location, orientation), movement, or acceleration of the movable object,carrier and/or payload. Such information from a payload may include datacaptured by the payload or a sensed state of the payload. The controldata provided transmitted by the terminal 1412 can be configured tocontrol a state of one or more of the movable object 1400, carrier 1402,or payload 1404. Alternatively or in combination, the carrier 1402 andpayload 1404 can also each include a communication module configured tocommunicate with terminal 1412, such that the terminal can communicatewith and control each of the movable object 1400, carrier 1402, andpayload 1404 independently.

In some embodiments, the movable object 1400 can be configured tocommunicate with another remote device in addition to the terminal 1412,or instead of the terminal 1412. The terminal 1412 may also beconfigured to communicate with another remote device as well as themovable object 1400. For example, the movable object 1400 and/orterminal 1412 may communicate with another movable object, or a carrieror payload of another movable object. When desired, the remote devicemay be a second terminal or other computing device (e.g., computer,laptop, tablet, smartphone, or other mobile device). The remote devicecan be configured to transmit data to the movable object 1400, receivedata from the movable object 1400, transmit data to the terminal 1412,and/or receive data from the terminal 1412. Optionally, the remotedevice can be connected to the Internet or other telecommunicationsnetwork, such that data received from the movable object 1400 and/orterminal 1412 can be uploaded to a website or server.

FIG. 15 is a schematic illustration by way of block diagram of a system1500 for controlling a movable object, in accordance with embodiments ofthe present invention. The system 1500 can be used in combination withany suitable embodiment of the systems, devices, and methods disclosedherein. The system 1500 can include a sensing module 1502, processingunit 1504, non-transitory computer readable medium 1506, control module1508, and communication module 1510.

The sensing module 1502 can utilize different types of sensors thatcollect information relating to the movable objects in different ways.Different types of sensors may sense different types of signals orsignals from different sources. For example, the sensors can includeinertial sensors, GPS sensors, proximity sensors (e.g., lidar), orvision/image sensors (e.g., a camera). The sensing module 1502 can beoperatively coupled to a processing unit 1504 having a plurality ofprocessors. In some embodiments, the sensing module can be operativelycoupled to a transmission module 1512 (e.g., a Wi-Fi image transmissionmodule) configured to directly transmit sensing data to a suitableexternal device or system. For example, the transmission module 1512 canbe used to transmit images captured by a camera of the sensing module1502 to a remote terminal.

The processing unit 1504 can have one or more processors, such as aprogrammable processor (e.g., a central processing unit (CPU)). Theprocessing unit 1504 can be operatively coupled to a non-transitorycomputer readable medium 1506. The non-transitory computer readablemedium 1506 can store logic, code, and/or program instructionsexecutable by the processing unit 1504 for performing one or more steps.The non-transitory computer readable medium can include one or morememory units (e.g., removable media or external storage such as an SDcard or random access memory (RAM)). In some embodiments, data from thesensing module 1502 can be directly conveyed to and stored within thememory units of the non-transitory computer readable medium 1506. Thememory units of the non-transitory computer readable medium 1506 canstore logic, code and/or program instructions executable by theprocessing unit 1504 to perform any suitable embodiment of the methodsdescribed herein. For example, the processing unit 1504 can beconfigured to execute instructions causing one or more processors of theprocessing unit 1504 to analyze sensing data produced by the sensingmodule. The memory units can store sensing data from the sensing moduleto be processed by the processing unit 1504. In some embodiments, thememory units of the non-transitory computer readable medium 1506 can beused to store the processing results produced by the processing unit1504.

In some embodiments, the processing unit 1504 can be operatively coupledto a control module 1508 configured to control a state of the movableobject. For example, the control module 1508 can be configured tocontrol the propulsion mechanisms of the movable object to adjust thespatial disposition, velocity, and/or acceleration of the movable objectwith respect to six degrees of freedom. Alternatively or in combination,the control module 1508 can control one or more of a state of a carrier,payload, or sensing module.

The processing unit 1504 can be operatively coupled to a communicationmodule 1510 configured to transmit and/or receive data from one or moreexternal devices (e.g., a terminal, display device, or other remotecontroller). Any suitable means of communication can be used, such aswired communication or wireless communication. For example, thecommunication module 1510 can utilize one or more of local area networks(LAN), wide area networks (WAN), infrared, radio, Wi-Fi, point-to-point(P2P) networks, telecommunication networks, cloud communication, and thelike. Optionally, relay stations, such as towers, satellites, or mobilestations, can be used. Wireless communications can be proximitydependent or proximity independent. In some embodiments, line-of-sightmay or may not be required for communications. The communication module1510 can transmit and/or receive one or more of sensing data from thesensing module 1502, processing results produced by the processing unit1504, predetermined control data, user commands from a terminal orremote controller, and the like.

The components of the system 1500 can be arranged in any suitableconfiguration. For example, one or more of the components of the system1500 can be located on the movable object, carrier, payload, terminal,sensing system, or an additional external device in communication withone or more of the above. Additionally, although FIG. 15 depicts asingle processing unit 1504 and a single non-transitory computerreadable medium 1506, one of skill in the art would appreciate that thisis not intended to be limiting, and that the system 1500 can include aplurality of processing units and/or non-transitory computer readablemedia. In some embodiments, one or more of the plurality of processingunits and/or non-transitory computer readable media can be situated atdifferent locations, such as on the movable object, carrier, payload,terminal, sensing module, additional external device in communicationwith one or more of the above, or suitable combinations thereof, suchthat any suitable aspect of the processing and/or memory functionsperformed by the system 1500 can occur at one or more of theaforementioned locations.

While preferred embodiments of the present invention have been shown anddescribed herein, it will be obvious to those skilled in the art thatsuch embodiments are provided by way of example only. Numerousvariations, changes, and substitutions will now occur to those skilledin the art without departing from the invention. It should be understoodthat various alternatives to the embodiments of the invention describedherein may be employed in practicing the invention. It is intended thatthe following claims define the scope of the invention and that methodsand structures within the scope of these claims and their equivalents becovered thereby.

What is claimed is:
 1. A system for capturing images, said systemcomprising: an optical element configured to separate light into a firstlight beam and a second light beam; a first lens module having a firstfocal length configured to focus the first light beam; a second lensmodule having a second focal length configured to focus the second lightbeam, wherein the second focal length is different from the first focallength; a first sensor configured to capture a first image from thefirst light beam focused by the first lens module onto the first sensor;and a second sensor configured to capture a second image from the secondlight beam focused by the second lens module onto the second sensor. 2.The system of claim 1, wherein the first image has a first field of viewand the second image has a second field of view different from the firstfield of view.
 3. The system of claim 2, wherein the second field ofview encompasses the first field of view or the first field of viewencompasses the second field of view.
 4. The system of claim 1, whereinthe first light beam is a reflected part of the light and the secondlight beam is a refracted part of the light.
 5. The system of claim 4,wherein the first lens module is a telescope lens module and the secondlens module is a wide-angled lens module.
 6. The system of claim 1,wherein a center of the first image and the second image coincide. 7.The system of claim 1, wherein the light passes through a singleaperture prior to contact with the optical element.
 8. The system ofclaim 1, further comprising one or more processors configured to (i)receive a desired focal length, and (ii) generate a combined image bycombining the first image with the second image, wherein the combinedimage has a field of view corresponding to the desired focal length. 9.The system of claim 8, wherein the one or more processors are configuredto scale the first image by$\frac{{the}\mspace{14mu} {desired}\mspace{14mu} {focal}{\mspace{11mu} \;}{length}}{{the}\mspace{14mu} {first}{\mspace{11mu} \;}{focal}\mspace{14mu} {length}}$and the second image by$\frac{{the}\mspace{14mu} {desired}\mspace{14mu} {focal}{\mspace{11mu} \;}{length}}{{the}{\; \mspace{11mu}}{second}{\mspace{11mu} \;}{focal}\mspace{14mu} {length}}.$10. The system of claim 9, wherein the one or more processors areconfigured to fuse the scaled first image and the scaled second image.11. The system of claim 10, wherein the combined image is comprisedwholly of fused parts when the desired focal length is greater than thefirst focal length and the second focal length.
 12. The system of claim10, wherein the combined image is comprised of an inner field of viewcomprised of fused parts and an outer field of view comprised of thefirst scaled image or the second scaled image, whichever has a widerfield of view when the desired focal length is between the first focallength and the second focal length.
 13. A method of capturing images,said method comprising: separating, with aid of an optical element,light into a first light beam and a second light beam; focusing, withaid of a first lens module having a first local length, the first lightbeam; focusing, with aid of a second lens module having a second focallength, the second light beam, wherein the second focal length isdifferent from the first focal length; capturing, with aid of a firstsensor, a first image from the first light beam focused by the firstlens module onto the first sensor; and capturing, with aid of a secondsensor, a second image from the second light beam focused by the secondlens module onto the second sensor.
 14. The method of claim 13, saidmethod further comprising: receiving, with aid of one or moreprocessors, a desired focal length; and generating a combined image bycombining the first image with the second image, wherein the combinedimage has a field of view corresponding to the desired focal length. 15.The method of claim 14, wherein the generating includes scaling thefirst image by$\frac{{the}\mspace{14mu} {desired}\mspace{14mu} {focal}{\mspace{11mu} \;}{length}}{{the}\mspace{14mu} {first}{\mspace{11mu} \;}{focal}\mspace{14mu} {length}}$and the second image by$\frac{{the}\mspace{14mu} {desired}\mspace{14mu} {focal}{\mspace{11mu} \;}{length}}{{the}{\; \mspace{11mu}}{second}{\mspace{11mu} \;}{focal}\mspace{14mu} {length}}.$16. The method of claim 15, wherein the generating further includesfusing the scaled first image and the scaled second image.
 17. Themethod of claim 16, wherein the combined image is comprised of an innerfield of view comprised of fused parts and an outer field of viewcomprised of the first scaled image or the second scaled image,whichever has a wider field of view when the desired focal length isbetween the first focal length and the second focal length.
 18. Themethod of claim 13, wherein the first light beam is a reflected part ofthe light and the second light beam is a refracted part of the light.19. The method of claim 13, wherein the first lens module is a telescopelens module and the second lens module is a wide-angled lens module. 20.A method of combining images, said method comprising: receiving, withaid of one or more processors, a first image generated by capturing afirst light beam from a light source receiving a second image generatedby capturing a second light beam of the light source, wherein the firstand second images have different fields of view; receiving a desiredfocal length; and generating a combined image based on the first andsecond images such that the combined image has a field of viewcorresponding to the desired focal length.